Results by Prompt Templates

What prompt you use can sometimes matter more than the model. Here we compare the performance of various prompt templates in PromptingTools.jl package.

Reminder: The below scores are on a scale 0-100, where 100 is the best possible score and 0 means the generated code was not even parseable.

# Imports
using JuliaLLMLeaderboard
using CairoMakie, AlgebraOfGraphics
using MarkdownTables, DataFramesMeta
using Statistics: mean, median, quantile;
unscrub_string(s::AbstractString) = split(s, "_") .|> titlecase |> x -> join(x, " ");

# ! Configuration
SAVE_PLOTS = false
DIR_RESULTS = joinpath(pkgdir(JuliaLLMLeaderboard), "code_generation")
PAID_MODELS_DEFAULT = [
    "gpt-3.5-turbo",
    "gpt-3.5-turbo-1106",
    "gpt-3.5-turbo-0125",
    "gpt-4-1106-preview",
    "gpt-4-0125-preview",
    "mistral-tiny",
    "mistral-small",
    "mistral-medium",
    "gemini-1.0-pro-latest",
];
PROMPTS = [
    "JuliaExpertCoTTask",
    "JuliaExpertAsk",
    "InJulia",
    "JuliaRecapTask",
    "JuliaRecapCoTTask",
];

Load Results

Use only the 5 most recent evaluations available for each definition/model/prompt

df = @chain begin
    load_evals(DIR_RESULTS; max_history = 5)
    # remove qwen models as they are not correct!
    @rsubset !occursin("qwen", :model)
end
12659×25 DataFrame
Rowdevicenamemodelprompt_labelprompt_strategyparsedexecutedunit_tests_counttimestampunit_tests_passedexperimentcostelapsed_secondsexamples_executedtokensversion_ptexamples_countversion_promptparametersschemafilenamescoretemperatureoptionstop_p
StringStringStringStringStringBoolBoolInt64StringInt64StringFloat64Float64Int64Array…StringInt64StringObject…StringStringFloat64Float64?Object…?Float64?
1Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructAsIs1SHOTfalsefalse420231213_230820__56600.013.55750[66, 402]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231213_230820__566.json0.0missingmissingmissing
2Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructAsIs1SHOTfalsefalse420231224_215740__78600.013.87310[88, 249]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231224_215740__786.json0.0missing{\n "num_gpu": 99\n}missing
3Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructAsIs1SHOTfalsefalse420231224_215751__14900.010.95870[88, 194]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231224_215751__149.json0.0missing{\n "num_gpu": 99\n}missing
4Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231213_230806__19300.08.654790[82, 255]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231213_230806__193.json50.0missingmissingmissing
5Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231224_215713__45300.016.58640[90, 299]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_215713__453.json50.0missing{\n "num_gpu": 99\n}missing
6Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231224_215726__57000.012.3390[90, 220]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_215726__570.json50.0missing{\n "num_gpu": 99\n}missing
7Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructInJulia1SHOTtruetrue420231226_205306__66200.016.67370[90, 302]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_205306__662.json50.0missing{\n "num_gpu": 99\n}missing
8Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231213_230757__38000.07.887540[112, 222]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231213_230757__380.json50.0missingmissingmissing
9Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231224_215643__49310.09.520423[129, 157]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_215643__493.json75.0missing{\n "num_gpu": 99\n}missing
10Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231224_215657__73600.012.87820[129, 220]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_215657__736.json50.0missing{\n "num_gpu": 99\n}missing
11Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue420231226_205249__83810.07.949841[129, 128]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_205249__838.json62.5missing{\n "num_gpu": 99\n}missing
12Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue420231213_230749__98400.022.77540[239, 589]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230749__984.json50.0missingmissingmissing
13Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse420231224_215629__13600.015.24460[257, 52]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215629__136.json0.0missing{\n "num_gpu": 99\n}missing
14Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse420231224_215634__38400.04.598770[257, 43]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215634__384.json0.0missing{\n "num_gpu": 99\n}missing
15Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse420231226_205241__76200.021.50780[257, 181]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205241__762.json0.0missing{\n "num_gpu": 99\n}missing
16Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue420231213_230900__25100.017.9320[11, 487]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230900__251.json50.0missingmissingmissing
17Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue420231224_215850__98310.020.5221[394, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215850__983.json62.5missing{\n "num_gpu": 99\n}missing
18Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse420231224_215919__85600.028.45540[394, 449]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215919__856.json0.0missing{\n "num_gpu": 99\n}missing
19Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue420231226_205426__53500.023.29390[394, 361]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205426__535.json50.0missing{\n "num_gpu": 99\n}missing
20Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTfalsefalse420231213_230842__93100.022.65440[383, 525]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231213_230842__931.json0.0missingmissingmissing
21Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTtruetrue420231224_215809__52500.018.10710[391, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_215809__525.json50.0missing{\n "num_gpu": 99\n}missing
22Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTtruetrue420231224_215830__70200.020.81760[391, 316]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_215830__702.json50.0missing{\n "num_gpu": 99\n}missing
23Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-instructJuliaRecapTask1SHOTtruetrue420231226_205402__39240.055.62994[391, 904]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_205402__392.json100.0missing{\n "num_gpu": 99\n}missing
24NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200037__72000.03.628310[0, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200037__720.json50.0missing{\n "num_gpu": 99\n}missing
25NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200041__85600.04.128480[0, 317]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200041__856.json50.0missing{\n "num_gpu": 99\n}missing
26NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MInJulia1SHOTtruefalse420240131_200044__54500.03.03930[0, 234]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200044__545.json25.0missing{\n "num_gpu": 99\n}missing
27NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200046__28210.01.707543[0, 132]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200046__282.json75.0missing{\n "num_gpu": 99\n}missing
28NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200048__34200.02.096850[0, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200048__342.json50.0missing{\n "num_gpu": 99\n}missing
29NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200009__21300.02.419360[0, 186]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200009__213.json50.0missing{\n "num_gpu": 99\n}missing
30NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420240131_200010__83500.00.6757950[0, 52]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200010__835.json0.0missing{\n "num_gpu": 99\n}missing
31NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420240131_200011__35200.00.6754730[0, 52]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200011__352.json0.0missing{\n "num_gpu": 99\n}missing
32NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200012__70100.00.7916570[0, 61]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200012__701.json50.0missing{\n "num_gpu": 99\n}missing
33NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200016__90010.02.081841[0, 160]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200016__900.json62.5missing{\n "num_gpu": 99\n}missing
34NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420240131_195954__67500.00.591230[0, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_195954__675.json0.0missing{\n "num_gpu": 99\n}missing
35NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_195956__96200.02.036110[0, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_195956__962.json50.0missing{\n "num_gpu": 99\n}missing
36NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_195958__54210.02.44454[0, 186]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_195958__542.json81.25missing{\n "num_gpu": 99\n}missing
37NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_200000__15410.01.982111[0, 151]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200000__154.json62.5missing{\n "num_gpu": 99\n}missing
38NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420240131_200001__29800.00.7752670[0, 59]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200001__298.json0.0missing{\n "num_gpu": 99\n}missing
39NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200158__31840.02.415924[0, 181]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200158__318.json100.0missing{\n "num_gpu": 99\n}missing
40NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420240131_200200__66900.01.89150[0, 142]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200200__669.json0.0missing{\n "num_gpu": 99\n}missing
41NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200203__63440.03.518444[0, 263]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200203__634.json100.0missing{\n "num_gpu": 99\n}missing
42NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200206__69200.02.105390[0, 158]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200206__692.json50.0missing{\n "num_gpu": 99\n}missing
43NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200209__30510.03.356624[0, 251]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200209__305.json81.25missing{\n "num_gpu": 99\n}missing
44NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200115__85810.08.217974[0, 605]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200115__858.json81.25missing{\n "num_gpu": 99\n}missing
45NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200121__44300.04.883340[0, 363]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200121__443.json50.0missing{\n "num_gpu": 99\n}missing
46NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200124__16010.02.778281[0, 208]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200124__160.json62.5missing{\n "num_gpu": 99\n}missing
47NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200126__85340.02.534944[0, 190]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200126__853.json100.0missing{\n "num_gpu": 99\n}missing
48NVIDIA-RTX-4090-4xadd_yearmonthcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200130__77440.03.55964[0, 266]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200130__774.json100.0missing{\n "num_gpu": 99\n}missing
49Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonAsIs1SHOTfalsefalse420231213_231000__69100.013.9740[66, 414]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__AsIs__1SHOT__20231213_231000__691.json0.0missingmissingmissing
50Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonAsIs1SHOTfalsefalse420231224_220100__22800.040.7050[61, 739]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__AsIs__1SHOT__20231224_220100__228.json0.0missing{\n "num_gpu": 99\n}missing
51Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonAsIs1SHOTfalsefalse420231224_220114__88400.014.20070[61, 261]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__AsIs__1SHOT__20231224_220114__884.json0.0missing{\n "num_gpu": 99\n}missing
52Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonInJulia1SHOTtruetrue420231213_230946__49600.017.02950[82, 499]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__InJulia__1SHOT__20231213_230946__496.json50.0missingmissingmissing
53Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonInJulia1SHOTfalsefalse420231224_220016__28600.012.5690[64, 230]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_220016__286.json0.0missing{\n "num_gpu": 99\n}missing
54Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonInJulia1SHOTfalsefalse420231224_220019__99000.03.500140[64, 57]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_220019__990.json0.0missing{\n "num_gpu": 99\n}missing
55Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse420231213_230929__13600.07.671150[112, 215]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231213_230929__136.json25.0missingmissingmissing
56Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse420231224_215950__86900.09.740120[66, 172]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_215950__869.json0.0missing{\n "num_gpu": 99\n}missing
57Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse420231224_220003__97500.013.28630[66, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_220003__975.json0.0missing{\n "num_gpu": 99\n}missing
58Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue420231213_230921__83400.020.61480[239, 530]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230921__834.json50.0missingmissingmissing
59Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse420231224_215937__26000.018.02860[132, 126]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215937__260.json0.0missing{\n "num_gpu": 99\n}missing
60Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse420231224_215940__81100.03.168630[132, 36]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231224_215940__811.json0.0missing{\n "num_gpu": 99\n}missing
61Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue420231213_231040__28200.017.97120[11, 488]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231040__282.json50.0missingmissingmissing
62Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse420231224_220130__60200.01.382210[83, 11]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220130__602.json0.0missing{\n "num_gpu": 99\n}missing
63Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse420231224_220132__81900.02.633890[83, 35]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220132__819.json0.0missing{\n "num_gpu": 99\n}missing
64Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse420231213_231022__28900.022.2880[383, 515]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231213_231022__289.json0.0missingmissingmissing
65Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse420231224_220118__21600.03.197810[80, 46]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_220118__216.json0.0missing{\n "num_gpu": 99\n}missing
66Apple-MacBook-Pro-M1add_yearmonthcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse420231224_220128__84900.010.86130[80, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_220128__849.json0.0missing{\n "num_gpu": 99\n}missing
67NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200632__29000.011.71370[0, 426]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200632__290.json50.0missing{\n "num_gpu": 99\n}missing
68NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200644__93010.011.51954[0, 419]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200644__930.json81.25missing{\n "num_gpu": 99\n}missing
69NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200652__36900.08.309750[0, 303]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200652__369.json50.0missing{\n "num_gpu": 99\n}missing
70NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200657__37900.04.577730[0, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200657__379.json50.0missing{\n "num_gpu": 99\n}missing
71NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse420240131_200704__49100.07.489480[0, 273]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200704__491.json0.0missing{\n "num_gpu": 99\n}missing
72NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200541__77310.02.030483[0, 74]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200541__773.json75.0missing{\n "num_gpu": 99\n}missing
73NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse420240131_200548__54400.07.452490[0, 271]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200548__544.json25.0missing{\n "num_gpu": 99\n}missing
74NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200553__58510.05.409221[0, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200553__585.json62.5missing{\n "num_gpu": 99\n}missing
75NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200555__77610.01.700794[0, 62]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200555__776.json81.25missing{\n "num_gpu": 99\n}missing
76NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420240131_200600__51700.04.245350[0, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200600__517.json0.0missing{\n "num_gpu": 99\n}missing
77NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420240131_200441__93200.04.72030[0, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200441__932.json25.0missing{\n "num_gpu": 99\n}missing
78NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420240131_200443__66900.01.490660[0, 54]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200443__669.json0.0missing{\n "num_gpu": 99\n}missing
79NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_200455__13700.012.79320[0, 460]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200455__137.json50.0missing{\n "num_gpu": 99\n}missing
80NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420240131_200504__98000.08.33670[0, 301]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200504__980.json25.0missing{\n "num_gpu": 99\n}missing
81NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_200511__78800.07.412110[0, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200511__788.json50.0missing{\n "num_gpu": 99\n}missing
82NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420240131_200915__92700.04.890630[0, 176]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200915__927.json0.0missing{\n "num_gpu": 99\n}missing
83NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200930__58110.015.44313[0, 552]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200930__581.json75.0missing{\n "num_gpu": 99\n}missing
84NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200949__64910.018.48571[0, 660]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200949__649.json62.5missing{\n "num_gpu": 99\n}missing
85NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420240131_200951__20400.01.696330[0, 61]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200951__204.json0.0missing{\n "num_gpu": 99\n}missing
86NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_201009__23700.018.31260[0, 654]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_201009__237.json50.0missing{\n "num_gpu": 99\n}missing
87NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200748__45010.07.131064[0, 256]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200748__450.json81.25missing{\n "num_gpu": 99\n}missing
88NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200803__13310.015.20053[0, 543]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200803__133.json75.0missing{\n "num_gpu": 99\n}missing
89NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200815__79840.011.43992[0, 409]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200815__798.json87.5missing{\n "num_gpu": 99\n}missing
90NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200826__19900.010.89750[0, 390]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200826__199.json50.0missing{\n "num_gpu": 99\n}missing
91NVIDIA-RTX-4090-4xadd_yearmonthcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200834__30510.08.764371[0, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200834__305.json62.5missing{\n "num_gpu": 99\n}missing
92NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue420240131_195546__56710.04.657353[96, 107]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_195546__567.json75.0missing{\n "num_gpu": 99\n}missing
93NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue420240131_195554__41100.07.928040[0, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_195554__411.json50.0missing{\n "num_gpu": 99\n}missing
94NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue420240131_195615__57100.020.75280[0, 512]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_195615__571.json50.0missing{\n "num_gpu": 99\n}missing
95NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse420240131_195624__50100.08.828630[0, 219]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_195624__501.json0.0missing{\n "num_gpu": 99\n}missing
96NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue420240131_195628__45910.04.255073[0, 106]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_195628__459.json75.0missing{\n "num_gpu": 99\n}missing
97NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse420240131_194948__71700.07.005960[0, 174]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_194948__717.json0.0missing{\n "num_gpu": 99\n}missing
98NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue420240131_194955__31100.06.877660[0, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_194955__311.json50.0missing{\n "num_gpu": 99\n}missing
99NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse420240131_195003__57400.07.644860[0, 190]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_195003__574.json0.0missing{\n "num_gpu": 99\n}missing
100NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue420240131_195009__91810.05.946251[0, 148]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_195009__918.json62.5missing{\n "num_gpu": 99\n}missing
101NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse420240131_195016__47000.07.451460[0, 185]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_195016__470.json0.0missing{\n "num_gpu": 99\n}missing
102NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse420240131_194825__37900.08.176440[0, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_194825__379.json0.0missing{\n "num_gpu": 99\n}missing
103NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue420240131_194837__78840.012.59144[0, 310]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_194837__788.json100.0missing{\n "num_gpu": 99\n}missing
104NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse420240131_194841__25100.03.397250[0, 84]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_194841__251.json0.0missing{\n "num_gpu": 99\n}missing
105NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruefalse420240131_194852__71300.011.15550[0, 275]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_194852__713.json25.0missing{\n "num_gpu": 99\n}missing
106NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue420240131_194856__58810.04.206163[0, 104]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_194856__588.json75.0missing{\n "num_gpu": 99\n}missing
107NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse420240131_195855__35600.010.00930[0, 245]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_195855__356.json0.0missing{\n "num_gpu": 99\n}missing
108NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue420240131_195907__26910.012.11093[0, 296]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_195907__269.json75.0missing{\n "num_gpu": 99\n}missing
109NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue420240131_195916__49410.09.353824[0, 229]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_195916__494.json81.25missing{\n "num_gpu": 99\n}missing
110NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse420240131_195934__34900.017.68270[0, 431]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_195934__349.json0.0missing{\n "num_gpu": 99\n}missing
111NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse420240131_195938__11100.03.984130[0, 98]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_195938__111.json0.0missing{\n "num_gpu": 99\n}missing
112NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue420240131_195729__35500.04.299620[0, 106]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_195729__355.json50.0missing{\n "num_gpu": 99\n}missing
113NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue420240131_195735__61100.05.568050[0, 137]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_195735__611.json50.0missing{\n "num_gpu": 99\n}missing
114NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse420240131_195740__25800.04.09960[0, 101]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_195740__258.json0.0missing{\n "num_gpu": 99\n}missing
115NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue420240131_195754__94010.014.2551[0, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_195754__940.json62.5missing{\n "num_gpu": 99\n}missing
116NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse420240131_195811__61600.016.55860[0, 404]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_195811__616.json0.0missing{\n "num_gpu": 99\n}missing
117NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_194052__51410.07.515693[0, 142]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_194052__514.json75.0missing{\n "num_gpu": 99\n}missing
118NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse420240131_194059__30500.07.145060[0, 135]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_194059__305.json0.0missing{\n "num_gpu": 99\n}missing
119NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse420240131_194115__24800.015.12080[0, 285]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_194115__248.json0.0missing{\n "num_gpu": 99\n}missing
120NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse420240131_194139__83900.024.81920[0, 466]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_194139__839.json0.0missing{\n "num_gpu": 99\n}missing
121NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse420240131_194207__28600.027.62150[0, 518]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_194207__286.json0.0missing{\n "num_gpu": 99\n}missing
122NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420240131_193849__14200.025.83020[0, 484]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_193849__142.json0.0missing{\n "num_gpu": 99\n}missing
123NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_193904__12510.014.45323[0, 272]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_193904__125.json75.0missing{\n "num_gpu": 99\n}missing
124NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420240131_193916__68500.012.27750[0, 231]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_193916__685.json0.0missing{\n "num_gpu": 99\n}missing
125NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_193927__12700.010.72010[0, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_193927__127.json50.0missing{\n "num_gpu": 99\n}missing
126NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420240131_193939__82500.011.41020[0, 215]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_193939__825.json0.0missing{\n "num_gpu": 99\n}missing
127NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420240131_193601__95500.019.05590[0, 356]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_193601__955.json0.0missing{\n "num_gpu": 99\n}missing
128NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420240131_193614__62200.012.16350[0, 228]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_193614__622.json0.0missing{\n "num_gpu": 99\n}missing
129NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_193641__25310.027.82194[0, 518]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_193641__253.json81.25missing{\n "num_gpu": 99\n}missing
130NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_193655__99700.013.06680[0, 245]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_193655__997.json50.0missing{\n "num_gpu": 99\n}missing
131NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_193709__38600.013.28980[0, 249]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_193709__386.json50.0missing{\n "num_gpu": 99\n}missing
132NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_194605__48710.015.54394[0, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_194605__487.json81.25missing{\n "num_gpu": 99\n}missing
133NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420240131_194616__61000.011.70830[0, 218]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_194616__610.json25.0missing{\n "num_gpu": 99\n}missing
134NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420240131_194641__31000.024.14120[0, 448]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_194641__310.json0.0missing{\n "num_gpu": 99\n}missing
135NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_194652__47840.011.21634[0, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_194652__478.json100.0missing{\n "num_gpu": 99\n}missing
136NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420240131_194701__88500.09.10830[0, 170]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_194701__885.json0.0missing{\n "num_gpu": 99\n}missing
137NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420240131_194357__67200.014.39230[0, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_194357__672.json25.0missing{\n "num_gpu": 99\n}missing
138NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse420240131_194401__22500.03.790910[0, 71]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_194401__225.json0.0missing{\n "num_gpu": 99\n}missing
139NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse420240131_194407__45700.06.193360[0, 116]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_194407__457.json0.0missing{\n "num_gpu": 99\n}missing
140NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_194432__51240.025.09874[0, 466]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_194432__512.json100.0missing{\n "num_gpu": 99\n}missing
141NVIDIA-RTX-4090-4xadd_yearmonthcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse420240131_194441__93900.09.154850[0, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_194441__939.json0.0missing{\n "num_gpu": 99\n}missing
142NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200250__10900.01.457820[0, 179]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200250__109.json50.0missing{\n "num_gpu": 99\n}missing
143NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200252__71910.01.821764[0, 223]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200252__719.json81.25missing{\n "num_gpu": 99\n}missing
144NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200253__92500.01.285690[0, 158]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200253__925.json50.0missing{\n "num_gpu": 99\n}missing
145NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200255__35800.01.98120[0, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200255__358.json50.0missing{\n "num_gpu": 99\n}missing
146NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue420240131_200257__29500.01.459550[0, 179]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_200257__295.json50.0missing{\n "num_gpu": 99\n}missing
147NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200238__67210.00.3605092[0, 44]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200238__672.json68.75missing{\n "num_gpu": 99\n}missing
148NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200239__47010.00.4903774[0, 60]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200239__470.json81.25missing{\n "num_gpu": 99\n}missing
149NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200240__28500.00.3943590[0, 48]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200240__285.json50.0missing{\n "num_gpu": 99\n}missing
150NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200240__30410.00.4920354[0, 60]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200240__304.json81.25missing{\n "num_gpu": 99\n}missing
151NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420240131_200241__28900.00.3927370[0, 48]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_200241__289.json50.0missing{\n "num_gpu": 99\n}missing
152NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420240131_200228__18600.02.857950[0, 345]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200228__186.json25.0missing{\n "num_gpu": 99\n}missing
153NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420240131_200230__24100.02.091150[0, 254]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200230__241.json25.0missing{\n "num_gpu": 99\n}missing
154NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420240131_200232__57510.02.269981[0, 275]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200232__575.json62.5missing{\n "num_gpu": 99\n}missing
155NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420240131_200235__89100.02.460830[0, 298]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200235__891.json25.0missing{\n "num_gpu": 99\n}missing
156NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420240131_200236__40700.01.100070[0, 134]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_200236__407.json0.0missing{\n "num_gpu": 99\n}missing
157NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200344__11900.01.49780[0, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200344__119.json50.0missing{\n "num_gpu": 99\n}missing
158NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200349__59400.04.326910[0, 513]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200349__594.json50.0missing{\n "num_gpu": 99\n}missing
159NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200350__74600.01.222290[0, 147]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200350__746.json50.0missing{\n "num_gpu": 99\n}missing
160NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420240131_200353__18410.02.225571[0, 266]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200353__184.json62.5missing{\n "num_gpu": 99\n}missing
161NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420240131_200355__87800.02.61450[0, 312]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_200355__878.json25.0missing{\n "num_gpu": 99\n}missing
162NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200307__40010.00.5262841[0, 63]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200307__400.json62.5missing{\n "num_gpu": 99\n}missing
163NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200309__24300.02.565390[0, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200309__243.json50.0missing{\n "num_gpu": 99\n}missing
164NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200314__38000.04.127770[0, 487]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200314__380.json50.0missing{\n "num_gpu": 99\n}missing
165NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200317__36910.03.026743[0, 359]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200317__369.json75.0missing{\n "num_gpu": 99\n}missing
166NVIDIA-RTX-4090-4xadd_yearmonthcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420240131_200324__43300.07.117970[0, 826]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_200324__433.json50.0missing{\n "num_gpu": 99\n}missing
167Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse420231219_205950__92100.011.89060[66, 351]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_205950__921.json0.0missingmissingmissing
168Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse420231219_210004__58400.013.850[1, 425]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_210004__584.json0.0missingmissingmissing
169Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse420231219_210023__32000.018.36550[1, 553]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_210023__320.json0.0missingmissingmissing
170Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse420231224_222446__61100.063.75890[80, 375]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_222446__611.json0.0missing{\n "num_gpu": 99\n}missing
171Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse420231224_222516__64500.030.11720[80, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_222516__645.json0.0missing{\n "num_gpu": 99\n}missing
172Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse420231219_205930__89600.012.93290[1, 399]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_205930__896.json0.0missingmissingmissing
173Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse420231219_205938__98900.08.490010[1, 260]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_205938__989.json25.0missingmissingmissing
174Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_222301__33200.050.05360[83, 287]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_222301__332.json50.0missing{\n "num_gpu": 99\n}missing
175Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_222342__55200.039.27430[83, 229]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_222342__552.json50.0missing{\n "num_gpu": 99\n}missing
176Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue420231226_210403__14600.032.36360[83, 191]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_210403__146.json50.0missing{\n "num_gpu": 99\n}missing
177Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_205855__89000.07.412820[1, 233]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_205855__890.json50.0missingmissingmissing
178Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231219_205901__34000.05.45590[1, 172]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_205901__340.json0.0missingmissingmissing
179Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_222043__59300.037.08560[124, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222043__593.json0.0missing{\n "num_gpu": 99\n}missing
180Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_222211__90300.088.17910[124, 482]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222211__903.json0.0missing{\n "num_gpu": 99\n}missing
181Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231226_210331__53700.046.31060[124, 272]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_210331__537.json0.0missing{\n "num_gpu": 99\n}missing
182Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231219_205826__21100.014.19750[1, 401]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_205826__211.json50.0missingmissingmissing
183Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231219_205837__77300.011.48110[1, 340]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_205837__773.json25.0missingmissingmissing
184Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_221918__36140.080.96474[252, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_221918__361.json100.0missing{\n "num_gpu": 99\n}missing
185Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_222005__40940.046.5834[252, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_222005__409.json100.0missing{\n "num_gpu": 99\n}missing
186Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231226_210244__14840.077.30584[252, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_210244__148.json100.0missing{\n "num_gpu": 99\n}missing
187Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231219_210157__12800.020.0670[1, 549]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210157__128.json50.0missingmissingmissing
188Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231219_210215__79000.018.19180[1, 501]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210215__790.json0.0missingmissingmissing
189Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_222805__50740.080.81564[412, 425]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_222805__507.json100.0missing{\n "num_gpu": 99\n}missing
190Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_222824__70610.019.52093[412, 58]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_222824__706.json75.0missing{\n "num_gpu": 99\n}missing
191Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231226_210644__75540.056.80964[412, 285]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210644__755.json100.0missing{\n "num_gpu": 99\n}missing
192Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_210059__80900.017.70740[1, 489]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210059__809.json25.0missingmissingmissing
193Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231219_210122__43900.022.22710[1, 603]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210122__439.json50.0missingmissingmissing
194Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_222548__55200.032.33840[410, 135]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_222548__552.json50.0missing{\n "num_gpu": 99\n}missing
195Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_222643__36300.054.11940[410, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_222643__363.json50.0missing{\n "num_gpu": 99\n}missing
196Apple-MacBook-Pro-M1add_yearmonthdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_210547__58900.0103.0520[410, 559]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_210547__589.json50.0missing{\n "num_gpu": 99\n}missing
197Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse420231226_211452__88300.05.420720[85, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_211452__883.json0.0missing{\n "num_gpu": 99\n}missing
198Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse420231227_095541__98600.013.5610[85, 516]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_095541__986.json0.0missing{\n "num_gpu": 99\n}missing
199Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse420231227_095551__78000.09.781930[85, 375]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_095551__780.json0.0missing{\n "num_gpu": 99\n}missing
200Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue420231227_095559__84800.08.360180[85, 321]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_095559__848.json50.0missing{\n "num_gpu": 99\n}missing
201Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue420231226_211446__83400.01.899110[122, 63]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_211446__834.json50.0missing{\n "num_gpu": 99\n}missing
202Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue420231227_095522__55900.07.512610[122, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_095522__559.json50.0missing{\n "num_gpu": 99\n}missing
203Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue420231227_095526__19400.04.21420[122, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_095526__194.json50.0missing{\n "num_gpu": 99\n}missing
204Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse420231227_095527__79700.01.56310[122, 49]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_095527__797.json0.0missing{\n "num_gpu": 99\n}missing
205Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue420231226_211444__67900.010.45010[234, 246]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211444__679.json50.0missing{\n "num_gpu": 99\n}missing
206Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231227_095458__90600.09.449090[234, 212]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095458__906.json0.0missing{\n "num_gpu": 99\n}missing
207Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue420231227_095508__39100.010.02840[234, 356]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095508__391.json50.0missing{\n "num_gpu": 99\n}missing
208Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231227_095514__17300.06.263060[234, 215]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095514__173.json0.0missing{\n "num_gpu": 99\n}missing
209Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231226_211518__80400.013.90770[374, 465]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211518__804.json0.0missing{\n "num_gpu": 99\n}missing
210Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231227_095631__15200.010.69410[374, 352]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095631__152.json0.0missing{\n "num_gpu": 99\n}missing
211Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_095636__47800.04.921650[374, 141]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095636__478.json50.0missing{\n "num_gpu": 99\n}missing
212Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_095646__35500.010.73560[374, 353]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095646__355.json50.0missing{\n "num_gpu": 99\n}missing
213Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse420231226_211504__64800.012.23950[371, 407]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_211504__648.json0.0missing{\n "num_gpu": 99\n}missing
214Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse420231227_095606__40500.06.970450[371, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_095606__405.json0.0missing{\n "num_gpu": 99\n}missing
215Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue420231227_095613__19400.06.771640[371, 210]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_095613__194.json50.0missing{\n "num_gpu": 99\n}missing
216Apple-MacBook-Pro-M1add_yearmonthdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse420231227_095620__39000.06.743540[371, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_095620__390.json25.0missing{\n "num_gpu": 99\n}missing
217Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestInJulia1SHOTfalsefalse420240217_104048__30000.02.297890[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104048__300.json0.0missingmissingmissing
218Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestInJulia1SHOTtruetrue420240217_104059__55900.010.07140[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104059__559.json50.0missingmissingmissing
219Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestInJulia1SHOTtruetrue420240217_104101__12900.01.968210[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104101__129.json50.0missingmissingmissing
220Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestInJulia1SHOTtruetrue420240217_104105__24100.03.904920[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104105__241.json50.0missingmissingmissing
221Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestInJulia1SHOTtruetrue420240217_113811__30300.04.524760[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_113811__303.json50.0missingmissingmissing
222Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue420240217_104017__43000.01.983630[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104017__430.json50.0missingmissingmissing
223Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue420240217_104027__69000.09.101820[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104027__690.json50.0missingmissingmissing
224Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue420240217_104028__96700.01.84630[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104028__967.json50.0missingmissingmissing
225Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue420240217_104031__80600.02.38480[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104031__806.json50.0missingmissingmissing
226Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue420240217_104033__43300.02.000720[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104033__433.json50.0missingmissingmissing
227Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse420240217_103926__56200.05.547280[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_103926__562.json25.0missingmissingmissing
228Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse420240217_103934__26300.07.938240[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_103934__263.json25.0missingmissingmissing
229Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse420240217_103937__36000.02.940720[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_103937__360.json25.0missingmissingmissing
230Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse420240217_103941__49800.03.860350[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_103941__498.json0.0missingmissingmissing
231Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue420240217_103950__31900.09.15950[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_103950__319.json50.0missingmissingmissing
232Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue420240217_104201__59700.03.574330[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104201__597.json50.0missingmissingmissing
233Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue420240217_104215__62600.014.28330[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104215__626.json50.0missingmissingmissing
234Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue420240217_104222__15200.06.811030[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104222__152.json50.0missingmissingmissing
235Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse420240217_104233__25600.011.3010[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104233__256.json25.0missingmissingmissing
236Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse420240217_104245__52800.011.26450[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104245__528.json25.0missingmissingmissing
237Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue420240217_104122__40100.01.958830[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104122__401.json50.0missingmissingmissing
238Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse420240217_104130__30600.07.239950[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104130__306.json0.0missingmissingmissing
239Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue420240217_104135__49600.04.864130[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104135__496.json50.0missingmissingmissing
240Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue420240217_104137__55500.02.683280[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104137__555.json50.0missingmissingmissing
241Apple-MacBook-Pro-M1add_yearmonthgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue420240217_104141__88400.03.269620[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104141__884.json50.0missingmissingmissing
242Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KInJulia1SHOTtruefalse420240223_211957__78300.026.21750[0, 404]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_211957__783.json25.0missingmissingmissing
243Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse420240223_212021__36100.024.15170[0, 375]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_212021__361.json0.0missingmissingmissing
244Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KInJulia1SHOTtruefalse420240223_212047__58500.026.02070[0, 402]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_212047__585.json25.0missingmissingmissing
245Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse420240223_212111__72100.023.23590[0, 362]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_212111__721.json0.0missingmissingmissing
246Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KInJulia1SHOTtruetrue420240223_212133__59400.022.55820[0, 349]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_212133__594.json50.0missingmissingmissing
247Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue420240223_211713__32000.01.522680[0, 24]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_211713__320.json50.0missingmissingmissing
248Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue420240223_211715__51800.01.578290[0, 25]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_211715__518.json50.0missingmissingmissing
249Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue420240223_211716__84100.01.583040[0, 25]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_211716__841.json50.0missingmissingmissing
250Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue420240223_211727__79300.010.81630[0, 169]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_211727__793.json50.0missingmissingmissing
251Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue420240223_211729__86400.01.535330[0, 24]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_211729__864.json50.0missingmissingmissing
252Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse420240223_211507__26400.024.34380[0, 374]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_211507__264.json0.0missingmissingmissing
253Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse420240223_211541__44100.034.07740[0, 520]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_211541__441.json0.0missingmissingmissing
254Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse420240223_211608__27600.027.03330[0, 412]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_211608__276.json0.0missingmissingmissing
255Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse420240223_211630__65800.021.54960[0, 332]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_211630__658.json25.0missingmissingmissing
256Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse420240223_211700__26900.030.65010[0, 472]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_211700__269.json0.0missingmissingmissing
257Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue420240223_212840__87200.025.78080[0, 397]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_212840__872.json50.0missingmissingmissing
258Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue420240223_212910__79300.030.15270[0, 464]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_212910__793.json50.0missingmissingmissing
259Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse420240223_212932__46400.022.37490[0, 346]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_212932__464.json0.0missingmissingmissing
260Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue420240223_213006__87100.033.46370[0, 514]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_213006__871.json50.0missingmissingmissing
261Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue420240223_213034__21100.027.92940[0, 430]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_213034__211.json50.0missingmissingmissing
262Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse420240223_212417__17900.021.85270[0, 338]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_212417__179.json0.0missingmissingmissing
263Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue420240223_212443__33700.026.87970[0, 414]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_212443__337.json50.0missingmissingmissing
264Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse420240223_212506__52400.022.35710[0, 346]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_212506__524.json25.0missingmissingmissing
265Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse420240223_212525__43800.019.34910[0, 298]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_212525__438.json0.0missingmissingmissing
266Apple-MacBook-Pro-M1add_yearmonthgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse420240223_212553__47600.028.23410[0, 431]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_212553__476.json0.0missingmissingmissing
267Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboAsIs1SHOTfalsefalse420231213_211438__69000.00045156.723120[72, 277]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_211438__690.json0.0missingmissingmissing
268Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboAsIs1SHOTfalsefalse420231225_181812__29300.00037954.989170[72, 229]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_181812__293.json0.0missingmissingmissing
269Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboAsIs1SHOTfalsefalse420231225_181817__41700.0003574.579240[72, 214]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_181817__417.json0.0missingmissingmissing
270Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo--optimAsIs1SHOTfalsefalse420231215_184723__86600.06.803910[72, 258]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_184723__866.json0.00.5missing0.5
271Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboInJulia1SHOTtruetrue420231213_211431__46700.00045155.990490[75, 276]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_211431__467.json50.0missingmissingmissing
272Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboInJulia1SHOTtruetrue420231225_181800__94600.0003394.108650[75, 201]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_181800__946.json50.0missingmissingmissing
273Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboInJulia1SHOTtruetrue420231225_181807__10200.00057156.45540[75, 356]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_181807__102.json50.0missingmissingmissing
274Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboInJulia1SHOTtruetrue420231227_185129__32300.0007898.513930[75, 501]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_185129__323.json50.0missingmissingmissing
275Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboInJulia1SHOTtruetrue420231227_185135__11800.00059556.569730[75, 372]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_185135__118.json50.0missingmissingmissing
276Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo--optimInJulia1SHOTtruetrue420231215_184716__54100.08.218240[75, 372]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_184716__541.json50.00.5missing0.5
277Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue420231213_211425__20400.0002773.74710[110, 148]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_211425__204.json50.0missingmissingmissing
278Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue420231225_181752__80200.00028152.584550[110, 151]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_181752__802.json50.0missingmissingmissing
279Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue420231225_181756__32410.0002983.629271[110, 162]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_181756__324.json62.5missingmissingmissing
280Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue420231227_185117__91700.00038654.27480[110, 221]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_185117__917.json50.0missingmissingmissing
281Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue420231227_185120__89800.0002592.856220[110, 136]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_185120__898.json50.0missingmissingmissing
282Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue420231215_184708__76500.07.966350[110, 376]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_184708__765.json50.00.5missing0.5
283Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse420231213_211421__74400.00028853.946750[211, 122]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_211421__744.json0.0missingmissingmissing
284Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse420231225_181742__74600.000293.905510[211, 123]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181742__746.json0.0missingmissingmissing
285Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue420231225_181749__69210.0006776.484673[211, 381]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181749__692.json75.0missingmissingmissing
286Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertCoTTask1SHOTtruefalse420231227_185110__60600.0006627.347410[211, 371]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185110__606.json25.0missingmissingmissing
287Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse420231227_185113__75200.0003142.687510[211, 139]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185113__752.json0.0missingmissingmissing
288Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse420231215_184700__82000.03.579480[211, 137]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_184700__820.json0.00.5missing0.5
289Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue420231213_211448__52700.0005486.166510[334, 254]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_211448__527.json50.0missingmissingmissing
290Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue420231225_181830__81300.0007677.06420[334, 400]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181830__813.json50.0missingmissingmissing
291Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue420231225_181837__72210.0006356.072251[334, 312]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181837__722.json62.5missingmissingmissing
292Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse420231227_185143__34000.00028551.51880[334, 79]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185143__340.json0.0missingmissingmissing
293Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse420231227_185146__27400.0003622.310490[334, 130]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185146__274.json0.0missingmissingmissing
294Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue420231215_184739__72100.06.730310[334, 330]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_184739__721.json50.00.5missing0.5
295Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse420231213_211442__13300.000393.73760[333, 149]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_211442__133.json0.0missingmissingmissing
296Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapTask1SHOTtruetrue420231225_181821__70900.0004984.262210[333, 221]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_181821__709.json50.0missingmissingmissing
297Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse420231225_181823__62400.00030752.202170[333, 94]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_181823__624.json0.0missingmissingmissing
298Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse420231227_185139__95000.00040653.06780[333, 160]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_185139__950.json0.0missingmissingmissing
299Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse420231227_185142__39400.0004443.28280[333, 185]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_185142__394.json0.0missingmissingmissing
300Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo--optimJuliaRecapTask1SHOTtruetrue420231215_184732__65200.08.393420[333, 360]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_184732__652.json50.00.5missing0.5
301Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125InJulia1SHOTtruetrue420240201_200118__92100.00023851.106060[75, 134]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200118__921.json50.0missingmissingmissing
302Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125InJulia1SHOTtruefalse420240201_200119__79700.00028651.469890[75, 166]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200119__797.json25.0missingmissingmissing
303Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125InJulia1SHOTtruetrue420240201_200120__22610.00019950.8822611[75, 108]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200120__226.json62.5missingmissingmissing
304Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125InJulia1SHOTtruetrue420240201_200122__39840.0003151.567694[75, 185]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200122__398.json100.0missingmissingmissing
305Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125InJulia1SHOTtruetrue420240201_200124__64500.00023251.241410[75, 130]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200124__645.json50.0missingmissingmissing
306Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue420240201_200114__95000.0001270.7512270[110, 48]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200114__950.json50.0missingmissingmissing
307Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue420240201_200115__71200.0001240.7791560[110, 46]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200115__712.json50.0missingmissingmissing
308Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue420240201_200115__78840.00012250.7513114[110, 45]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200115__788.json100.0missingmissingmissing
309Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue420240201_200116__19040.00012250.5784634[110, 45]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200116__190.json100.0missingmissingmissing
310Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue420240201_200117__35040.00011950.5870464[110, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200117__350.json100.0missingmissingmissing
311Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue420240201_200108__56410.0002571.096894[211, 101]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200108__564.json81.25missingmissingmissing
312Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue420240201_200109__32840.0002781.001244[211, 115]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200109__328.json100.0missingmissingmissing
313Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue420240201_200110__26640.0002660.9084594[211, 107]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200110__266.json100.0missingmissingmissing
314Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue420240201_200112__68740.0003771.563544[211, 181]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200112__687.json100.0missingmissingmissing
315Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue420240201_200113__14140.00024650.8536014[211, 94]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200113__141.json100.0missingmissingmissing
316Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse420240201_200129__13800.0003170.9241060[334, 100]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200129__138.json0.0missingmissingmissing
317Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue420240201_200131__21440.00043551.623624[334, 179]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200131__214.json100.0missingmissingmissing
318Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse420240201_200131__83500.00029750.8592860[334, 87]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200131__835.json0.0missingmissingmissing
319Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse420240201_200132__60500.0002960.9630060[334, 86]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200132__605.json0.0missingmissingmissing
320Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse420240201_200134__73100.0003111.099570[334, 96]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200134__731.json0.0missingmissingmissing
321Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue420240201_200124__33500.0002370.752760[333, 47]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200124__335.json50.0missingmissingmissing
322Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue420240201_200125__13600.00022950.7315220[333, 42]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200125__136.json50.0missingmissingmissing
323Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue420240201_200126__34940.0002310.720854[333, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200126__349.json100.0missingmissingmissing
324Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue420240201_200127__81110.00025350.8223071[333, 58]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200127__811.json62.5missingmissingmissing
325Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue420240201_200128__29910.00025350.7219341[333, 58]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200128__299.json62.5missingmissingmissing
326Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106AsIs1SHOTfalsefalse420231213_211456__60600.00042.966320[72, 164]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_211456__606.json0.0missingmissingmissing
327Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106AsIs1SHOTfalsefalse420231225_181850__27800.0002722.002360[72, 100]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_181850__278.json0.0missingmissingmissing
328Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106AsIs1SHOTfalsefalse420231225_181852__42800.0002681.924770[72, 98]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_181852__428.json0.0missingmissingmissing
329Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse420231215_184753__94600.05.32910[72, 218]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_184753__946.json0.00.9missing0.1
330Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106InJulia1SHOTtruetrue420231213_211453__47340.0003352.18024[75, 130]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_211453__473.json100.0missingmissingmissing
331Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106InJulia1SHOTtruetrue420231225_181846__58900.0005293.495580[75, 227]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_181846__589.json50.0missingmissingmissing
332Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106InJulia1SHOTtruetrue420231225_181848__47200.0003312.364650[75, 128]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_181848__472.json50.0missingmissingmissing
333Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106InJulia1SHOTtruetrue420231227_185154__21640.0004313.339074[75, 178]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_185154__216.json100.0missingmissingmissing
334Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106InJulia1SHOTtruetrue420231227_185157__86710.0002652.149671[75, 95]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_185157__867.json62.5missingmissingmissing
335Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue420231215_184748__32800.05.408720[75, 162]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_184748__328.json50.00.9missing0.1
336Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue420231213_211451__54710.0001961.222674[110, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_211451__547.json81.25missingmissingmissing
337Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue420231225_181841__33300.0001980.9984360[110, 44]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_181841__333.json50.0missingmissingmissing
338Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue420231225_181842__31940.0001961.08574[110, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_181842__319.json100.0missingmissingmissing
339Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue420231227_185150__28040.0001961.435574[110, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_185150__280.json100.0missingmissingmissing
340Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue420231227_185151__16340.0001880.9538494[110, 39]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_185151__163.json100.0missingmissingmissing
341Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue420231215_184742__61740.01.796374[110, 43]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_184742__617.json100.00.9missing0.1
342Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue420231213_211449__30240.0002970.9634514[211, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_211449__302.json100.0missingmissingmissing
343Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue420231225_181838__34140.0002931.366264[211, 41]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181838__341.json100.0missingmissingmissing
344Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue420231225_181840__83440.0002971.253624[211, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181840__834.json100.0missingmissingmissing
345Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue420231227_185147__50940.0002991.121414[211, 44]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185147__509.json100.0missingmissingmissing
346Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue420231227_185148__81440.0002971.453144[211, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185148__814.json100.0missingmissingmissing
347Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue420231215_184740__66040.01.373814[211, 43]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_184740__660.json100.00.9missing0.1
348Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse420231213_211459__95000.0005462.13090[334, 106]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_211459__950.json0.0missingmissingmissing
349Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse420231225_181859__20400.000512.2260[334, 88]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181859__204.json0.0missingmissingmissing
350Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse420231225_181900__67600.000531.612340[334, 98]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181900__676.json0.0missingmissingmissing
351Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse420231227_185202__52600.0006022.560990[334, 134]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185202__526.json0.0missingmissingmissing
352Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse420231227_185205__67900.000592.922310[334, 128]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185205__679.json0.0missingmissingmissing
353Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse420231215_184758__96500.02.63010[334, 97]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_184758__965.json0.00.9missing0.1
354Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue420231213_211457__55740.0004191.134384[333, 43]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_211457__557.json100.0missingmissingmissing
355Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue420231225_181854__98100.0004911.844410[333, 79]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_181854__981.json50.0missingmissingmissing
356Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue420231225_181855__51910.0004151.169941[333, 41]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_181855__519.json62.5missingmissingmissing
357Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue420231227_185158__40110.0004491.38131[333, 58]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_185158__401.json62.5missingmissingmissing
358Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue420231227_185200__66210.0004251.074281[333, 46]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_185200__662.json62.5missingmissingmissing
359Apple-MacBook-Pro-M1add_yearmonthgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue420231215_184755__37940.01.930174[333, 43]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_184755__379.json100.00.9missing0.1
360Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewInJulia1SHOTtruetrue420240201_063725__50200.015336.23990[75, 485]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_063725__502.json50.0missingmissingmissing
361Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewInJulia1SHOTtruetrue420240201_063811__65140.0167445.54162[75, 533]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_063811__651.json87.5missingmissingmissing
362Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewInJulia1SHOTtruetrue420240201_063847__36010.0133836.40694[75, 421]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_063847__360.json81.25missingmissingmissing
363Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewInJulia1SHOTtruefalse420240201_063922__90300.0135334.34510[75, 426]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_063922__903.json25.0missingmissingmissing
364Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewInJulia1SHOTtruetrue420240201_064040__67900.0188478.46090[75, 603]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_064040__679.json50.0missingmissingmissing
365Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue420240201_063255__32540.002424.058594[110, 44]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_063255__325.json100.0missingmissingmissing
366Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue420240201_063259__94140.002423.998294[110, 44]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_063259__941.json100.0missingmissingmissing
367Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue420240201_063303__22740.002363.788364[110, 42]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_063303__227.json100.0missingmissingmissing
368Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue420240201_063307__48840.002363.788674[110, 42]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_063307__488.json100.0missingmissingmissing
369Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue420240201_063313__78210.003325.991431[110, 74]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_063313__782.json62.5missingmissingmissing
370Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue420240201_063039__45640.0098524.45514[211, 258]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_063039__456.json100.0missingmissingmissing
371Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue420240201_063055__79740.0075715.86274[211, 182]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_063055__797.json100.0missingmissingmissing
372Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue420240201_063127__54440.0124332.56774[211, 344]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_063127__544.json100.0missingmissingmissing
373Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue420240201_063207__18740.0149239.45944[211, 427]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_063207__187.json100.0missingmissingmissing
374Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue420240201_063229__52640.008821.71734[211, 223]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_063229__526.json100.0missingmissingmissing
375Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruefalse420240201_065114__45600.0184339.36390[334, 503]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_065114__456.json25.0missingmissingmissing
376Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue420240201_065224__27700.0202370.36070[334, 563]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_065224__277.json50.0missingmissingmissing
377Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue420240201_065248__26440.0131524.08832[334, 327]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_065248__264.json87.5missingmissingmissing
378Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue420240201_065316__16100.0183727.4670[334, 501]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_065316__161.json50.0missingmissingmissing
379Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue420240201_065407__53210.020851.12384[334, 582]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_065407__532.json81.25missingmissingmissing
380Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapTask1SHOTtruefalse420240201_064455__24500.0178556.56540[333, 484]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_064455__245.json25.0missingmissingmissing
381Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue420240201_064534__21540.0159939.03634[333, 422]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_064534__215.json100.0missingmissingmissing
382Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue420240201_064612__81300.0155137.52220[333, 406]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_064612__813.json50.0missingmissingmissing
383Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue420240201_064645__35540.0180633.07394[333, 491]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_064645__355.json100.0missingmissingmissing
384Apple-MacBook-Pro-M1add_yearmonthgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue420240201_064716__67010.0149131.1884[333, 386]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_064716__670.json81.25missingmissingmissing
385Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewAsIs1SHOTfalsefalse420231213_211657__77500.0131135.24110[72, 413]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_211657__775.json0.0missingmissingmissing
386Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewAsIs1SHOTfalsefalse420231225_182107__59200.0116422.24030[72, 364]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_182107__592.json0.0missingmissingmissing
387Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewAsIs1SHOTfalsefalse420231225_182140__12200.0139232.75770[72, 440]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_182140__122.json0.0missingmissingmissing
388Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-preview--optimAsIs1SHOTfalsefalse420231215_185011__74500.035.49720[72, 305]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_185011__745.json0.00.1missing0.9
389Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewInJulia1SHOTtruetrue420231213_211622__56300.0102343.02240[75, 316]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_211622__563.json50.0missingmissingmissing
390Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewInJulia1SHOTtruetrue420231225_182015__64400.0150923.99050[75, 478]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_182015__644.json50.0missingmissingmissing
391Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewInJulia1SHOTtruetrue420231225_182045__83700.0128429.41920[75, 403]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_182045__837.json50.0missingmissingmissing
392Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewInJulia1SHOTtruefalse420231227_185405__11300.0168930.46440[75, 538]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_185405__113.json25.0missingmissingmissing
393Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewInJulia1SHOTtruetrue420231227_185431__98900.0118225.98590[75, 369]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_185431__989.json50.0missingmissingmissing
394Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-preview--optimInJulia1SHOTtruetrue420231215_184935__42300.056.59060[75, 477]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_184935__423.json50.00.1missing0.9
395Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue420231213_211538__34710.004499.112773[110, 113]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_211538__347.json75.0missingmissingmissing
396Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue420231225_181944__23740.006267.417354[110, 172]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_181944__237.json100.0missingmissingmissing
397Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue420231225_181951__67940.005276.846494[110, 139]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_181951__679.json100.0missingmissingmissing
398Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue420231227_185324__67640.0052412.40564[110, 138]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_185324__676.json100.0missingmissingmissing
399Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue420231227_185335__90940.0068910.79344[110, 193]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_185335__909.json100.0missingmissingmissing
400Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue420231215_184838__93840.012.37664[110, 123]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_184838__938.json100.00.1missing0.9
401Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse420231213_211529__53400.0142629.55790[211, 405]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_211529__534.json25.0missingmissingmissing
402Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue420231225_181926__15540.0164225.77564[211, 477]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181926__155.json100.0missingmissingmissing
403Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue420231225_181936__69840.007939.810114[211, 194]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181936__698.json100.0missingmissingmissing
404Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue420231227_185243__69440.0104537.38054[211, 278]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185243__694.json100.0missingmissingmissing
405Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue420231227_185311__30840.0171728.37394[211, 502]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185311__308.json100.0missingmissingmissing
406Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue420231215_184826__58340.028.02874[211, 385]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_184826__583.json100.00.1missing0.9
407Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue420231213_211815__58600.0160935.27460[334, 425]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_211815__586.json50.0missingmissingmissing
408Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue420231225_182254__46000.0151330.0520[334, 393]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182254__460.json50.0missingmissingmissing
409Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue420231225_182332__21600.0186737.71990[334, 511]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182332__216.json50.0missingmissingmissing
410Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue420231227_185637__71310.0165741.37084[334, 441]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185637__713.json81.25missingmissingmissing
411Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue420231227_185657__72340.0119519.18394[334, 287]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185657__723.json100.0missingmissingmissing
412Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue420231215_185121__28100.027.63730[334, 359]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_185121__281.json50.00.1missing0.9
413Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue420231213_211739__41500.0190842.27220[333, 525]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_211739__415.json50.0missingmissingmissing
414Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue420231225_182209__91540.0147629.58844[333, 381]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_182209__915.json100.0missingmissingmissing
415Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue420231225_182224__69110.0156314.43054[333, 410]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_182224__691.json81.25missingmissingmissing
416Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue420231227_185513__37510.0127541.47834[333, 314]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_185513__375.json81.25missingmissingmissing
417Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue420231227_185556__64100.0178542.30430[333, 484]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_185556__641.json50.0missingmissingmissing
418Apple-MacBook-Pro-M1add_yearmonthgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue420231215_185053__57400.042.65580[333, 434]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_185053__574.json50.00.1missing0.9
419Apple-MacBook-Pro-M1add_yearmonthllama2AsIs1SHOTfalsefalse420231213_230236__72500.013.63280[66, 402]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__AsIs__1SHOT__20231213_230236__725.json0.0missingmissingmissing
420Apple-MacBook-Pro-M1add_yearmonthllama2AsIs1SHOTfalsefalse420231224_214048__27300.012.73550[66, 379]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__AsIs__1SHOT__20231224_214048__273.json0.0missing{\n "num_gpu": 99\n}missing
421Apple-MacBook-Pro-M1add_yearmonthllama2AsIs1SHOTfalsefalse420231224_214103__18700.015.61830[1, 475]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__AsIs__1SHOT__20231224_214103__187.json0.0missing{\n "num_gpu": 99\n}missing
422Apple-MacBook-Pro-M1add_yearmonthllama2AsIs1SHOTfalsefalse420231226_203525__34800.08.979740[66, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__AsIs__1SHOT__20231226_203525__348.json0.0missing{\n "num_gpu": 99\n}missing
423Apple-MacBook-Pro-M1add_yearmonthllama2AsIs1SHOTfalsefalse420231226_203539__29500.014.29250[1, 440]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__AsIs__1SHOT__20231226_203539__295.json0.0missing{\n "num_gpu": 99\n}missing
424Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruetrue420231224_214015__49600.07.848190[82, 232]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231224_214015__496.json50.0missing{\n "num_gpu": 99\n}missing
425Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruetrue420231224_214035__18300.019.70870[1, 589]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231224_214035__183.json50.0missing{\n "num_gpu": 99\n}missing
426Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruetrue420231226_203505__27900.017.05460[82, 502]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231226_203505__279.json50.0missing{\n "num_gpu": 99\n}missing
427Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruetrue420231226_203516__28100.010.52210[1, 324]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231226_203516__281.json50.0missing{\n "num_gpu": 99\n}missing
428Apple-MacBook-Pro-M1add_yearmonthllama2InJulia1SHOTtruetrue420231226_204455__22300.032.66980[82, 909]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__InJulia__1SHOT__20231226_204455__223.json50.0missing{\n "num_gpu": 99\n}missing
429Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231224_213957__49700.09.377550[112, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_213957__497.json50.0missing{\n "num_gpu": 99\n}missing
430Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruefalse420231224_214007__22600.08.226320[1, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_214007__226.json25.0missing{\n "num_gpu": 99\n}missing
431Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231226_203439__91600.07.461960[112, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_203439__916.json50.0missing{\n "num_gpu": 99\n}missing
432Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231226_203448__72800.09.344180[1, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_203448__728.json50.0missing{\n "num_gpu": 99\n}missing
433Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertAsk1SHOTtruetrue420231226_204422__11100.06.615630[112, 181]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_204422__111.json50.0missing{\n "num_gpu": 99\n}missing
434Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTfalsefalse420231224_213929__41300.022.65260[257, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_213929__413.json0.0missing{\n "num_gpu": 99\n}missing
435Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTtruefalse420231224_213947__37800.017.31610[1, 493]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_213947__378.json25.0missing{\n "num_gpu": 99\n}missing
436Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTtruefalse420231226_203420__90200.020.01840[257, 366]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_203420__902.json25.0missing{\n "num_gpu": 99\n}missing
437Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTfalsefalse420231226_203431__63800.011.55760[1, 339]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_203431__638.json0.0missing{\n "num_gpu": 99\n}missing
438Apple-MacBook-Pro-M1add_yearmonthllama2JuliaExpertCoTTask1SHOTtruetrue420231226_204414__83200.023.94620[257, 395]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204414__832.json50.0missing{\n "num_gpu": 99\n}missing
439Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTtruetrue420231213_230308__13200.014.07840[11, 382]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230308__132.json50.0missingmissingmissing
440Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTfalsefalse420231224_214151__94400.016.17890[11, 442]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214151__944.json0.0missing{\n "num_gpu": 99\n}missing
441Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTtruetrue420231224_214220__27900.029.37450[1, 774]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214220__279.json50.0missing{\n "num_gpu": 99\n}missing
442Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTfalsefalse420231226_203647__52800.019.1070[11, 519]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_203647__528.json0.0missing{\n "num_gpu": 99\n}missing
443Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapCoTTask1SHOTtruetrue420231226_204536__90000.018.1730[11, 497]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_204536__900.json50.0missing{\n "num_gpu": 99\n}missing
444Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTtruefalse420231224_214121__10500.017.3190[383, 387]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_214121__105.json25.0missing{\n "num_gpu": 99\n}missing
445Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTtruetrue420231224_214135__48900.013.75190[1, 385]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_214135__489.json50.0missing{\n "num_gpu": 99\n}missing
446Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTtruetrue420231226_203603__89000.023.7460[383, 554]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_203603__890.json50.0missing{\n "num_gpu": 99\n}missing
447Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTfalsefalse420231226_203627__97600.024.18530[1, 651]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_203627__976.json0.0missing{\n "num_gpu": 99\n}missing
448Apple-MacBook-Pro-M1add_yearmonthllama2JuliaRecapTask1SHOTfalsefalse420231226_204517__69000.022.28870[383, 513]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_204517__690.json0.0missing{\n "num_gpu": 99\n}missing
449Apple-MacBook-Pro-M1add_yearmonthmagicoderAsIs1SHOTfalsefalse420231213_231138__20900.012.06180[66, 359]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__AsIs__1SHOT__20231213_231138__209.json0.0missingmissingmissing
450Apple-MacBook-Pro-M1add_yearmonthmagicoderAsIs1SHOTfalsefalse420231224_220236__12500.06.669440[80, 214]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__AsIs__1SHOT__20231224_220236__125.json0.0missing{\n "num_gpu": 99\n}missing
451Apple-MacBook-Pro-M1add_yearmonthmagicoderAsIs1SHOTfalsefalse420231224_220242__95500.06.461640[80, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__AsIs__1SHOT__20231224_220242__955.json0.0missing{\n "num_gpu": 99\n}missing
452Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTfalsefalse420231213_231126__92000.014.85930[82, 437]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231213_231126__920.json0.0missingmissingmissing
453Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTtruetrue420231224_220223__78200.011.02840[82, 360]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231224_220223__782.json50.0missing{\n "num_gpu": 99\n}missing
454Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTtruetrue420231224_220229__21800.05.769610[82, 183]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231224_220229__218.json50.0missing{\n "num_gpu": 99\n}missing
455Apple-MacBook-Pro-M1add_yearmonthmagicoderInJulia1SHOTtruetrue420231226_205457__29000.06.936980[82, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__InJulia__1SHOT__20231226_205457__290.json50.0missing{\n "num_gpu": 99\n}missing
456Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruetrue420231213_231111__16800.09.175010[112, 260]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231213_231111__168.json50.0missingmissingmissing
457Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruetrue420231224_220207__67100.07.378780[122, 232]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_220207__671.json50.0missing{\n "num_gpu": 99\n}missing
458Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruetrue420231224_220212__56900.04.67550[122, 141]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_220212__569.json50.0missing{\n "num_gpu": 99\n}missing
459Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertAsk1SHOTtruefalse420231226_205450__20400.08.694680[122, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_205450__204.json25.0missing{\n "num_gpu": 99\n}missing
460Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTtruefalse420231213_231102__24600.021.76430[239, 563]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231102__246.json25.0missingmissingmissing
461Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTtruefalse420231224_220149__42800.016.52620[249, 313]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220149__428.json25.0missing{\n "num_gpu": 99\n}missing
462Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTtruetrue420231224_220159__58200.010.39470[249, 308]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220159__582.json50.0missing{\n "num_gpu": 99\n}missing
463Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaExpertCoTTask1SHOTfalsefalse420231226_205441__85300.015.22130[249, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205441__853.json0.0missing{\n "num_gpu": 99\n}missing
464Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231213_231216__15400.020.03060[11, 540]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231216__154.json50.0missingmissingmissing
465Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231224_220311__47100.011.09450[386, 302]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220311__471.json50.0missing{\n "num_gpu": 99\n}missing
466Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231224_220324__27700.012.18120[386, 336]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220324__277.json50.0missing{\n "num_gpu": 99\n}missing
467Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapCoTTask1SHOTtruetrue420231226_205513__19400.010.0790[386, 271]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205513__194.json50.0missing{\n "num_gpu": 99\n}missing
468Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruetrue420231213_231156__78800.018.16150[383, 410]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231213_231156__788.json50.0missingmissingmissing
469Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruefalse420231224_220251__37900.08.740370[383, 232]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_220251__379.json25.0missing{\n "num_gpu": 99\n}missing
470Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruetrue420231224_220300__97700.09.061960[383, 242]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_220300__977.json50.0missing{\n "num_gpu": 99\n}missing
471Apple-MacBook-Pro-M1add_yearmonthmagicoderJuliaRecapTask1SHOTtruetrue420231226_205503__69500.05.896350[383, 141]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_205503__695.json50.0missing{\n "num_gpu": 99\n}missing
472Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue420231227_174325__52700.011.92710[82, 223]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174325__527.json50.0missing{\n "num_gpu": 99\n}missing
473Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue420231227_174339__42400.014.39410[82, 276]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174339__424.json50.0missing{\n "num_gpu": 99\n}missing
474Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue420231227_174354__56400.014.44030[82, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174354__564.json50.0missing{\n "num_gpu": 99\n}missing
475Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue420231227_174254__94100.010.65990[122, 199]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174254__941.json50.0missing{\n "num_gpu": 99\n}missing
476Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue420231227_174303__58900.08.876120[122, 163]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174303__589.json50.0missing{\n "num_gpu": 99\n}missing
477Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue420231227_174313__32800.09.567520[122, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174313__328.json50.0missing{\n "num_gpu": 99\n}missing
478Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue420231227_174205__93400.021.97070[249, 262]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174205__934.json50.0missing{\n "num_gpu": 99\n}missing
479Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse420231227_174226__54700.020.74350[249, 376]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174226__547.json25.0missing{\n "num_gpu": 99\n}missing
480Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse420231227_174243__10700.017.52980[249, 318]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174243__107.json25.0missing{\n "num_gpu": 99\n}missing
481Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_174442__73000.014.36440[386, 237]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174442__730.json50.0missing{\n "num_gpu": 99\n}missing
482Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_174454__80600.012.21360[386, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174454__806.json50.0missing{\n "num_gpu": 99\n}missing
483Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue420231227_174510__98700.016.22360[386, 252]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174510__987.json50.0missing{\n "num_gpu": 99\n}missing
484Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue420231227_174406__57100.012.29340[383, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174406__571.json50.0missing{\n "num_gpu": 99\n}missing
485Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue420231227_174416__96900.09.196560[383, 139]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174416__969.json50.0missing{\n "num_gpu": 99\n}missing
486Apple-MacBook-Pro-M1add_yearmonthmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue420231227_174427__51400.011.46430[383, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174427__514.json50.0missing{\n "num_gpu": 99\n}missing
487Apple-MacBook-Pro-M1add_yearmonthmistral-mediumAsIs1SHOTfalsefalse420231213_212013__91200.0039805412.84410[78, 466]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__AsIs__1SHOT__20231213_212013__912.json0.0missingmissingmissing
488Apple-MacBook-Pro-M1add_yearmonthmistral-mediumAsIs1SHOTfalsefalse420231225_182707__98700.003333348.596280[78, 386]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__AsIs__1SHOT__20231225_182707__987.json0.0missingmissingmissing
489Apple-MacBook-Pro-M1add_yearmonthmistral-mediumAsIs1SHOTfalsefalse420231225_182720__25600.0045872912.23660[78, 541]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__AsIs__1SHOT__20231225_182720__256.json0.0missingmissingmissing
490Apple-MacBook-Pro-M1add_yearmonthmistral-medium--optimAsIs1SHOTfalsefalse420231215_185518__77700.025.35630[78, 256]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__AsIs__1SHOT__20231215_185518__777.json0.00.9missing0.3
491Apple-MacBook-Pro-M1add_yearmonthmistral-mediumInJulia1SHOTtruetrue420231213_212000__20900.0040102114.13160[80, 469]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__InJulia__1SHOT__20231213_212000__209.json50.0missingmissingmissing
492Apple-MacBook-Pro-M1add_yearmonthmistral-mediumInJulia1SHOTtruetrue420231225_182648__40700.0027724414.92250[80, 316]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__InJulia__1SHOT__20231225_182648__407.json50.0missingmissingmissing
493Apple-MacBook-Pro-M1add_yearmonthmistral-mediumInJulia1SHOTtruefalse420231225_182659__39400.0033306510.68980[80, 385]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__InJulia__1SHOT__20231225_182659__394.json25.0missingmissingmissing
494Apple-MacBook-Pro-M1add_yearmonthmistral-mediumInJulia1SHOTtruetrue420231227_185941__95500.004746412.71090[80, 560]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__InJulia__1SHOT__20231227_185941__955.json50.0missingmissingmissing
495Apple-MacBook-Pro-M1add_yearmonthmistral-mediumInJulia1SHOTtruetrue420231227_185955__63500.0052641614.19640[80, 624]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__InJulia__1SHOT__20231227_185955__635.json50.0missingmissingmissing
496Apple-MacBook-Pro-M1add_yearmonthmistral-medium--optimInJulia1SHOTtruetrue420231215_185453__73600.048.84520[80, 533]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__InJulia__1SHOT__20231215_185453__736.json50.00.9missing0.3
497Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertAsk1SHOTtruetrue420231213_211946__68200.001594133.557260[120, 157]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_211946__682.json50.0missingmissingmissing
498Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertAsk1SHOTtruefalse420231225_182622__44300.0042800114.23550[120, 489]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_182622__443.json25.0missingmissingmissing
499Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertAsk1SHOTtruetrue420231225_182633__62710.0021280711.00421[120, 223]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_182633__627.json62.5missingmissingmissing
500Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertAsk1SHOTtruetrue420231227_185924__79200.002006724.770380[120, 208]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_185924__792.json50.0missingmissingmissing
501Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertAsk1SHOTtruefalse420231227_185928__48200.001853014.343760[120, 189]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_185928__482.json25.0missingmissingmissing
502Apple-MacBook-Pro-M1add_yearmonthmistral-medium--optimJuliaExpertAsk1SHOTtruetrue420231215_185404__38400.049.89230[120, 503]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_185404__384.json50.00.9missing0.3
503Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertCoTTask1SHOTtruetrue420231213_211943__16300.0053348313.01980[247, 577]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_211943__163.json50.0missingmissingmissing
504Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertCoTTask1SHOTtruetrue420231225_182554__63310.0043640310.37351[247, 457]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182554__633.json62.5missingmissingmissing
505Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertCoTTask1SHOTtruetrue420231225_182607__38410.0054480913.42331[247, 591]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182607__384.json62.5missingmissingmissing
506Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertCoTTask1SHOTtruefalse420231227_185906__30700.0045581918.05580[247, 481]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185906__307.json25.0missingmissingmissing
507Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaExpertCoTTask1SHOTtruetrue420231227_185919__24610.004954612.27671[247, 530]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185919__246.json62.5missingmissingmissing
508Apple-MacBook-Pro-M1add_yearmonthmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue420231215_185314__73710.054.43641[247, 558]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_185314__737.json62.50.9missing0.3
509Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapCoTTask1SHOTtruefalse420231213_212041__91000.004173028.844830[383, 388]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212041__910.json25.0missingmissingmissing
510Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapCoTTask1SHOTtruetrue420231225_182848__14040.0063411414.96664[383, 656]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182848__140.json100.0missingmissingmissing
511Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapCoTTask1SHOTtruefalse420231225_182913__94000.004836424.5710[383, 470]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182913__940.json25.0missingmissingmissing
512Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapCoTTask1SHOTtruetrue420231227_190118__39900.0071663240.71370[383, 758]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190118__399.json50.0missingmissingmissing
513Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapCoTTask1SHOTtruetrue420231227_190139__48110.0056130419.98244[383, 566]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190139__481.json81.25missingmissingmissing
514Apple-MacBook-Pro-M1add_yearmonthmistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue420231215_185731__76810.069.51751[383, 672]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_185731__768.json62.50.9missing0.3
515Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapTask1SHOTtruetrue420231213_212032__32110.0074413718.23891[380, 793]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_212032__321.json62.5missingmissingmissing
516Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapTask1SHOTtruetrue420231225_182753__19210.0087681333.64524[380, 957]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_182753__192.json81.25missingmissingmissing
517Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapTask1SHOTtruetrue420231225_182833__45100.0068993438.92160[380, 726]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_182833__451.json50.0missingmissingmissing
518Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapTask1SHOTtruefalse420231227_190021__82900.0066161925.39090[380, 691]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_190021__829.json25.0missingmissingmissing
519Apple-MacBook-Pro-M1add_yearmonthmistral-mediumJuliaRecapTask1SHOTfalsefalse420231227_190038__27400.006850816.77810[380, 720]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_190038__274.json0.0missingmissingmissing
520Apple-MacBook-Pro-M1add_yearmonthmistral-medium--optimJuliaRecapTask1SHOTtruefalse420231215_185621__85200.062.95790[380, 630]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_185621__852.json25.00.9missing0.3
521Apple-MacBook-Pro-M1add_yearmonthmistral-smallAsIs1SHOTfalsefalse420231213_211915__14000.0007236464.941910[78, 347]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__AsIs__1SHOT__20231213_211915__140.json0.0missingmissingmissing
522Apple-MacBook-Pro-M1add_yearmonthmistral-smallAsIs1SHOTfalsefalse420231225_182508__51800.0005587463.650510[78, 262]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__AsIs__1SHOT__20231225_182508__518.json0.0missingmissingmissing
523Apple-MacBook-Pro-M1add_yearmonthmistral-smallAsIs1SHOTfalsefalse420231225_182510__87800.0003375862.286130[78, 148]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__AsIs__1SHOT__20231225_182510__878.json0.0missingmissingmissing
524Apple-MacBook-Pro-M1add_yearmonthmistral-small--optimAsIs1SHOTfalsefalse420231215_185203__46600.06.008410[78, 456]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__AsIs__1SHOT__20231215_185203__466.json0.00.9missing0.3
525Apple-MacBook-Pro-M1add_yearmonthmistral-smallInJulia1SHOTtruetrue420231213_211910__41100.000387382.39260[80, 173]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__InJulia__1SHOT__20231213_211910__411.json50.0missingmissingmissing
526Apple-MacBook-Pro-M1add_yearmonthmistral-smallInJulia1SHOTtruetrue420231225_182456__47000.000788966.56070[80, 380]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__InJulia__1SHOT__20231225_182456__470.json50.0missingmissingmissing
527Apple-MacBook-Pro-M1add_yearmonthmistral-smallInJulia1SHOTtruetrue420231225_182504__14000.001046987.501620[80, 513]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__InJulia__1SHOT__20231225_182504__140.json50.0missingmissingmissing
528Apple-MacBook-Pro-M1add_yearmonthmistral-smallInJulia1SHOTtruetrue420231227_185802__34500.000794785.187980[80, 383]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__InJulia__1SHOT__20231227_185802__345.json50.0missingmissingmissing
529Apple-MacBook-Pro-M1add_yearmonthmistral-smallInJulia1SHOTtruetrue420231227_185810__76940.001219648.100224[80, 602]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__InJulia__1SHOT__20231227_185810__769.json100.0missingmissingmissing
530Apple-MacBook-Pro-M1add_yearmonthmistral-small--optimInJulia1SHOTtruetrue420231215_185157__11410.02.285224[80, 167]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__InJulia__1SHOT__20231215_185157__114.json81.250.9missing0.3
531Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertAsk1SHOTtruetrue420231213_211907__58400.0009053745.841420[122, 426]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_211907__584.json50.0missingmissingmissing
532Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertAsk1SHOTtruetrue420231225_182446__84800.0004106742.9120[122, 171]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_182446__848.json50.0missingmissingmissing
533Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertAsk1SHOTtruefalse420231225_182450__85300.0005464744.15220[122, 241]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_182450__853.json25.0missingmissingmissing
534Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertAsk1SHOTfalsefalse420231227_185754__61900.0003369541.938320[122, 133]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_185754__619.json0.0missingmissingmissing
535Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertAsk1SHOTtruetrue420231227_185757__89400.0004455942.69640[122, 189]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_185757__894.json50.0missingmissingmissing
536Apple-MacBook-Pro-M1add_yearmonthmistral-small--optimJuliaExpertAsk1SHOTtruefalse420231215_185155__72600.02.535410[122, 182]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_185155__726.json25.00.9missing0.3
537Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertCoTTask1SHOTtruetrue420231213_211901__47640.0007857834.461994[249, 322]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_211901__476.json100.0missingmissingmissing
538Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertCoTTask1SHOTfalsefalse420231225_182433__78100.0002891431.092730[249, 66]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182433__781.json0.0missingmissingmissing
539Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertCoTTask1SHOTtruetrue420231225_182443__97910.001495829.460591[249, 688]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182443__979.json62.5missingmissingmissing
540Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertCoTTask1SHOTtruetrue420231227_185745__66440.0005335832.769234[249, 192]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185745__664.json100.0missingmissingmissing
541Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaExpertCoTTask1SHOTtruetrue420231227_185752__47400.001069026.369440[249, 468]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185752__474.json50.0missingmissingmissing
542Apple-MacBook-Pro-M1add_yearmonthmistral-small--optimJuliaExpertCoTTask1SHOTtruetrue420231215_185152__38540.02.554974[249, 182]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_185152__385.json100.00.9missing0.3
543Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapCoTTask1SHOTtruetrue420231213_211929__98800.001162846.497230[388, 470]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_211929__988.json50.0missingmissingmissing
544Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapCoTTask1SHOTtruetrue420231225_182533__53210.001285069.096754[388, 533]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182533__532.json81.25missingmissingmissing
545Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapCoTTask1SHOTtruetrue420231225_182543__85910.001603229.950214[388, 697]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182543__859.json81.25missingmissingmissing
546Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapCoTTask1SHOTtruetrue420231227_185840__68410.001170614.12791[388, 474]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185840__684.json62.5missingmissingmissing
547Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapCoTTask1SHOTtruetrue420231227_185848__68210.00121917.934564[388, 499]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185848__682.json81.25missingmissingmissing
548Apple-MacBook-Pro-M1add_yearmonthmistral-small--optimJuliaRecapCoTTask1SHOTtruetrue420231215_185219__82410.08.891694[388, 661]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_185219__824.json81.250.9missing0.3
549Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapTask1SHOTtruetrue420231213_211923__70710.001262427.234864[386, 522]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_211923__707.json81.25missingmissingmissing
550Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapTask1SHOTtruetrue420231225_182517__78440.001202286.731994[386, 491]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_182517__784.json100.0missingmissingmissing
551Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapTask1SHOTtruetrue420231225_182523__68600.00114996.319960[386, 464]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_182523__686.json50.0missingmissingmissing
552Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapTask1SHOTtruetrue420231227_185819__83140.001413748.334384[386, 600]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_185819__831.json100.0missingmissingmissing
553Apple-MacBook-Pro-M1add_yearmonthmistral-smallJuliaRecapTask1SHOTtruetrue420231227_185826__51610.001165426.737934[386, 472]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_185826__516.json81.25missingmissingmissing
554Apple-MacBook-Pro-M1add_yearmonthmistral-small--optimJuliaRecapTask1SHOTtruetrue420231215_185210__70910.07.310054[386, 541]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_185210__709.json81.250.9missing0.3
555Apple-MacBook-Pro-M1add_yearmonthmistral-tinyAsIs1SHOTfalsefalse420231213_211836__74000.0001672054.95980[78, 345]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__AsIs__1SHOT__20231213_211836__740.json0.0missingmissingmissing
556Apple-MacBook-Pro-M1add_yearmonthmistral-tinyAsIs1SHOTfalsefalse420231225_182406__85000.0001894023.685930[78, 394]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__AsIs__1SHOT__20231225_182406__850.json0.0missingmissingmissing
557Apple-MacBook-Pro-M1add_yearmonthmistral-tinyAsIs1SHOTfalsefalse420231225_182413__58100.0001128456.941350[78, 225]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__AsIs__1SHOT__20231225_182413__581.json0.0missingmissingmissing
558Apple-MacBook-Pro-M1add_yearmonthmistral-tiny--optimAsIs1SHOTfalsefalse420231215_185140__67100.04.694010[78, 342]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__AsIs__1SHOT__20231215_185140__671.json0.00.9missing0.3
559Apple-MacBook-Pro-M1add_yearmonthmistral-tinyInJulia1SHOTtruetrue420231213_211831__41500.0002408716.205230[80, 507]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__InJulia__1SHOT__20231213_211831__415.json50.0missingmissingmissing
560Apple-MacBook-Pro-M1add_yearmonthmistral-tinyInJulia1SHOTfalsefalse420231225_182359__53500.000160693.041370[80, 330]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__InJulia__1SHOT__20231225_182359__535.json0.0missingmissingmissing
561Apple-MacBook-Pro-M1add_yearmonthmistral-tinyInJulia1SHOTfalsefalse420231225_182402__53900.0001665793.170150[80, 343]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__InJulia__1SHOT__20231225_182402__539.json0.0missingmissingmissing
562Apple-MacBook-Pro-M1add_yearmonthmistral-tinyInJulia1SHOTtruetrue420231227_185720__59600.0001326042.397820[80, 268]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__InJulia__1SHOT__20231227_185720__596.json50.0missingmissingmissing
563Apple-MacBook-Pro-M1add_yearmonthmistral-tinyInJulia1SHOTtruetrue420231227_185724__81500.0001828873.368560[80, 379]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__InJulia__1SHOT__20231227_185724__815.json50.0missingmissingmissing
564Apple-MacBook-Pro-M1add_yearmonthmistral-tiny--optimInJulia1SHOTfalsefalse420231215_185135__48400.05.181980[80, 627]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__InJulia__1SHOT__20231215_185135__484.json0.00.9missing0.3
565Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertAsk1SHOTfalsefalse420231213_211825__35100.000107682.303950[122, 200]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_211825__351.json0.0missingmissingmissing
566Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertAsk1SHOTtruetrue420231225_182354__66309.2731e-51.642320[122, 167]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_182354__663.json50.0missingmissingmissing
567Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertAsk1SHOTfalsefalse420231225_182356__84709.6808e-51.735920[122, 176]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_182356__847.json0.0missingmissingmissing
568Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertAsk1SHOTtruetrue420231227_185715__23808.0047e-51.372260[122, 139]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_185715__238.json50.0missingmissingmissing
569Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertAsk1SHOTtruetrue420231227_185717__50419.4996e-51.617934[122, 172]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_185717__504.json81.25missingmissingmissing
570Apple-MacBook-Pro-M1add_yearmonthmistral-tiny--optimJuliaExpertAsk1SHOTfalsefalse420231215_185130__20800.01.326790[122, 152]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_185130__208.json0.00.9missing0.3
571Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertCoTTask1SHOTtruetrue420231213_211823__82300.0002201377.767770[249, 409]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_211823__823.json50.0missingmissingmissing
572Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertCoTTask1SHOTtruefalse420231225_182345__96600.00016532412.92140[249, 288]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182345__966.json25.0missingmissingmissing
573Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertCoTTask1SHOTtruetrue420231225_182352__23300.0003465246.406340[249, 688]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182352__233.json50.0missingmissingmissing
574Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertCoTTask1SHOTtruetrue420231227_185705__42100.0001413158.265770[249, 235]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185705__421.json50.0missingmissingmissing
575Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse420231227_185714__90700.0003573968.862040[249, 712]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_185714__907.json0.0missingmissingmissing
576Apple-MacBook-Pro-M1add_yearmonthmistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue420231215_185128__37800.07.108320[249, 576]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_185128__378.json50.00.9missing0.3
577Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapCoTTask1SHOTtruetrue420231213_211857__51000.00032249611.85510[388, 592]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_211857__510.json50.0missingmissingmissing
578Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapCoTTask1SHOTfalsefalse420231225_182426__72100.0002654184.140920[388, 466]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182426__721.json0.0missingmissingmissing
579Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapCoTTask1SHOTtruetrue420231225_182432__77300.0003496765.695360[388, 652]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182432__773.json50.0missingmissingmissing
580Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapCoTTask1SHOTfalsefalse420231227_185738__54400.0002694954.236820[388, 475]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185738__544.json0.0missingmissingmissing
581Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapCoTTask1SHOTfalsefalse420231227_185743__18000.0002803674.502070[388, 499]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_185743__180.json0.0missingmissingmissing
582Apple-MacBook-Pro-M1add_yearmonthmistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue420231215_185149__67100.04.85330[388, 562]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_185149__671.json50.00.9missing0.3
583Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapTask1SHOTfalsefalse420231213_211845__15500.0003435078.375710[386, 639]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_211845__155.json0.0missingmissingmissing
584Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapTask1SHOTtruetrue420231225_182417__57810.0002520013.898831[386, 437]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_182417__578.json62.5missingmissingmissing
585Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapTask1SHOTtruetrue420231225_182422__95000.0002968484.72980[386, 536]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_182422__950.json50.0missingmissingmissing
586Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapTask1SHOTtruetrue420231227_185726__60100.0001822392.596370[386, 283]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_185726__601.json50.0missingmissingmissing
587Apple-MacBook-Pro-M1add_yearmonthmistral-tinyJuliaRecapTask1SHOTtruetrue420231227_185733__59710.0003806536.513611[386, 721]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_185733__597.json62.5missingmissingmissing
588Apple-MacBook-Pro-M1add_yearmonthmistral-tiny--optimJuliaRecapTask1SHOTtruetrue420231215_185144__68710.03.951894[386, 463]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_185144__687.json81.250.9missing0.3
589Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse420231219_210856__82500.010.96520[66, 328]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_210856__825.json0.0missingmissingmissing
590Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse420231219_210913__60800.016.8390[1, 512]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_210913__608.json0.0missingmissingmissing
591Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse420231219_210924__32800.011.45330[1, 357]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_210924__328.json0.0missingmissingmissing
592Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse420231224_223326__49900.011.36220[76, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_223326__499.json0.0missing{\n "num_gpu": 99\n}missing
593Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse420231224_223329__48700.02.512190[76, 53]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_223329__487.json0.0missing{\n "num_gpu": 99\n}missing
594Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse420231219_210835__10000.017.06240[1, 518]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_210835__100.json25.0missingmissingmissing
595Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue420231219_210845__98900.09.959850[1, 313]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_210845__989.json50.0missingmissingmissing
596Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_223313__64300.04.22270[79, 98]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_223313__643.json50.0missing{\n "num_gpu": 99\n}missing
597Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue420231224_223315__98800.02.138130[79, 43]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_223315__988.json50.0missing{\n "num_gpu": 99\n}missing
598Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue420231226_210906__34700.05.068740[79, 120]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_210906__347.json50.0missing{\n "num_gpu": 99\n}missing
599Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_210754__27500.08.080970[1, 253]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210754__275.json50.0missingmissingmissing
600Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_210803__58200.08.467450[1, 265]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210803__582.json50.0missingmissingmissing
601Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_223303__39400.03.46280[121, 73]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223303__394.json0.0missing{\n "num_gpu": 99\n}missing
602Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue420231224_223308__84300.05.148640[121, 117]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223308__843.json50.0missing{\n "num_gpu": 99\n}missing
603Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231226_210901__26900.02.931790[121, 59]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_210901__269.json0.0missing{\n "num_gpu": 99\n}missing
604Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231219_210716__68200.012.29020[1, 362]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210716__682.json50.0missingmissingmissing
605Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231219_210737__39500.020.77730[1, 589]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210737__395.json0.0missingmissingmissing
606Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231224_223243__92700.022.73120[248, 403]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223243__927.json0.0missing{\n "num_gpu": 99\n}missing
607Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_223300__34400.017.15180[248, 403]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223300__344.json50.0missing{\n "num_gpu": 99\n}missing
608Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231226_210858__50200.023.09420[248, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_210858__502.json25.0missing{\n "num_gpu": 99\n}missing
609Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231219_211104__52600.022.29040[1, 604]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211104__526.json25.0missingmissingmissing
610Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231219_211126__44800.022.05550[1, 598]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211126__448.json50.0missingmissingmissing
611Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223403__29900.010.08770[388, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223403__299.json50.0missing{\n "num_gpu": 99\n}missing
612Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223422__81500.019.82350[388, 442]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223422__815.json50.0missing{\n "num_gpu": 99\n}missing
613Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231226_210941__28900.019.19320[388, 426]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210941__289.json0.0missing{\n "num_gpu": 99\n}missing
614Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231219_211003__57300.020.91960[1, 570]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211003__573.json25.0missingmissingmissing
615Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231219_211021__69800.017.93650[1, 495]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211021__698.json50.0missingmissingmissing
616Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse420231224_223342__90700.012.71210[386, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223342__907.json25.0missing{\n "num_gpu": 99\n}missing
617Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_223352__87600.010.70430[386, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223352__876.json50.0missing{\n "num_gpu": 99\n}missing
618Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_210922__80400.015.30310[386, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_210922__804.json50.0missing{\n "num_gpu": 99\n}missing
619Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue420231227_222026__91400.016.070[78, 472]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222026__914.json50.0missing{\n "num_gpu": 99\n}missing
620Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse420231227_222038__66300.011.59740[78, 337]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222038__663.json0.0missing{\n "num_gpu": 99\n}missing
621Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue420231227_222054__86800.015.3460[78, 450]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222054__868.json50.0missing{\n "num_gpu": 99\n}missing
622Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue420231227_222111__32210.017.16714[78, 506]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222111__322.json81.25missing{\n "num_gpu": 99\n}missing
623Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse420231227_222126__89600.014.9960[78, 444]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_222126__896.json25.0missing{\n "num_gpu": 99\n}missing
624Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_221944__54200.05.809320[120, 170]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_221944__542.json0.0missing{\n "num_gpu": 99\n}missing
625Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_221950__30200.05.801340[120, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_221950__302.json0.0missing{\n "num_gpu": 99\n}missing
626Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue420231227_221957__82600.06.683580[120, 190]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_221957__826.json50.0missing{\n "num_gpu": 99\n}missing
627Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_222002__84300.05.214870[120, 147]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_222002__843.json0.0missing{\n "num_gpu": 99\n}missing
628Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse420231227_222010__18400.08.176280[120, 229]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_222010__184.json0.0missing{\n "num_gpu": 99\n}missing
629Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse420231227_221828__50100.015.85880[247, 282]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221828__501.json25.0missing{\n "num_gpu": 99\n}missing
630Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue420231227_221851__97000.022.77240[247, 671]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221851__970.json50.0missing{\n "num_gpu": 99\n}missing
631Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue420231227_221906__85400.014.16240[247, 411]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221906__854.json50.0missing{\n "num_gpu": 99\n}missing
632Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse420231227_221917__23000.010.94610[247, 310]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221917__230.json25.0missing{\n "num_gpu": 99\n}missing
633Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue420231227_221938__42110.021.51884[247, 628]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_221938__421.json81.25missing{\n "num_gpu": 99\n}missing
634Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue420231227_222348__46710.032.31771[387, 887]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222348__467.json62.5missing{\n "num_gpu": 99\n}missing
635Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue420231227_222400__44000.011.38980[387, 298]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222400__440.json50.0missing{\n "num_gpu": 99\n}missing
636Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse420231227_222415__65100.014.86020[387, 396]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222415__651.json0.0missing{\n "num_gpu": 99\n}missing
637Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse420231227_222427__36400.012.48230[387, 320]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222427__364.json0.0missing{\n "num_gpu": 99\n}missing
638Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse420231227_222440__89500.012.31220[387, 316]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_222440__895.json0.0missing{\n "num_gpu": 99\n}missing
639Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue420231227_222152__48200.025.63240[385, 687]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222152__482.json50.0missing{\n "num_gpu": 99\n}missing
640Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse420231227_222217__23000.025.18690[385, 676]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222217__230.json0.0missing{\n "num_gpu": 99\n}missing
641Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue420231227_222240__25100.022.88270[385, 616]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222240__251.json50.0missing{\n "num_gpu": 99\n}missing
642Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse420231227_222259__44400.018.79280[385, 502]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222259__444.json25.0missing{\n "num_gpu": 99\n}missing
643Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue420231227_222315__86600.016.25740[385, 422]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_222315__866.json50.0missing{\n "num_gpu": 99\n}missing
644Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse420231227_222725__92300.024.56150[78, 606]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222725__923.json0.0missing{\n "num_gpu": 99\n}missing
645Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue420231227_222742__18700.016.98180[78, 425]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222742__187.json50.0missing{\n "num_gpu": 99\n}missing
646Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue420231227_222753__39200.010.8630[78, 269]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222753__392.json50.0missing{\n "num_gpu": 99\n}missing
647Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue420231227_222812__30800.018.61860[78, 466]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222812__308.json50.0missing{\n "num_gpu": 99\n}missing
648Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse420231227_222823__36200.010.70150[78, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_222823__362.json25.0missing{\n "num_gpu": 99\n}missing
649Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222627__30600.08.628020[120, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222627__306.json50.0missing{\n "num_gpu": 99\n}missing
650Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222633__64210.05.974851[120, 136]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222633__642.json62.5missing{\n "num_gpu": 99\n}missing
651Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222642__97300.07.440110[120, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222642__973.json50.0missing{\n "num_gpu": 99\n}missing
652Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222649__35900.07.059340[120, 164]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222649__359.json50.0missing{\n "num_gpu": 99\n}missing
653Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_222700__37200.011.2880[120, 272]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_222700__372.json50.0missing{\n "num_gpu": 99\n}missing
654Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222514__18900.034.53220[247, 689]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222514__189.json50.0missing{\n "num_gpu": 99\n}missing
655Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222531__74100.016.96640[247, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222531__741.json50.0missing{\n "num_gpu": 99\n}missing
656Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222554__40300.022.01290[247, 515]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222554__403.json50.0missing{\n "num_gpu": 99\n}missing
657Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231227_222605__24900.011.51670[247, 257]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222605__249.json0.0missing{\n "num_gpu": 99\n}missing
658Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_222618__69200.012.48480[247, 281]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_222618__692.json50.0missing{\n "num_gpu": 99\n}missing
659Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231227_223106__19700.024.42110[387, 550]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223106__197.json0.0missing{\n "num_gpu": 99\n}missing
660Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223116__63000.010.08630[387, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223116__630.json50.0missing{\n "num_gpu": 99\n}missing
661Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223148__19400.031.79650[387, 724]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223148__194.json50.0missing{\n "num_gpu": 99\n}missing
662Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223213__31800.024.80270[387, 559]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223213__318.json50.0missing{\n "num_gpu": 99\n}missing
663Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_223239__95200.025.51920[387, 576]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223239__952.json50.0missing{\n "num_gpu": 99\n}missing
664Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse420231227_222852__56200.029.10680[385, 661]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_222852__562.json0.0missing{\n "num_gpu": 99\n}missing
665Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_222918__10800.026.29440[385, 595]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_222918__108.json50.0missing{\n "num_gpu": 99\n}missing
666Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_222945__68110.026.85972[385, 608]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_222945__681.json68.75missing{\n "num_gpu": 99\n}missing
667Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_223017__12800.031.43531[385, 716]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_223017__128.json56.25missing{\n "num_gpu": 99\n}missing
668Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse420231227_223042__33000.024.39460[385, 549]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_223042__330.json0.0missing{\n "num_gpu": 99\n}missing
669Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse420231226_115434__74200.022.42860[75, 410]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_115434__742.json0.0missing{\n "num_gpu": 99\n}missing
670Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse420231226_115500__65500.026.22670[75, 480]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_115500__655.json0.0missing{\n "num_gpu": 99\n}missing
671Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse420231226_115349__33900.032.22540[78, 584]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115349__339.json25.0missing{\n "num_gpu": 99\n}missing
672Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue420231226_115411__68400.021.93770[78, 401]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115411__684.json50.0missing{\n "num_gpu": 99\n}missing
673Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse420231226_211310__75000.024.35640[78, 448]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_211310__750.json25.0missing{\n "num_gpu": 99\n}missing
674Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue420231226_115305__77900.04.334530[120, 67]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115305__779.json50.0missing{\n "num_gpu": 99\n}missing
675Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse420231226_115316__94100.011.3130[120, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115316__941.json0.0missing{\n "num_gpu": 99\n}missing
676Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse420231226_211246__29700.017.58960[120, 318]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_211246__297.json0.0missing{\n "num_gpu": 99\n}missing
677Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue420231226_115225__91800.034.55110[247, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115225__918.json50.0missing{\n "num_gpu": 99\n}missing
678Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue420231226_115300__23100.032.39573[247, 557]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115300__231.json68.75missing{\n "num_gpu": 99\n}missing
679Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231226_211228__84500.028.71220[247, 320]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211228__845.json0.0missing{\n "num_gpu": 99\n}missing
680Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231226_115621__49810.023.66153[387, 390]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_115621__498.json75.0missing{\n "num_gpu": 99\n}missing
681Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231226_115655__17100.033.43950[387, 561]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_115655__171.json50.0missing{\n "num_gpu": 99\n}missing
682Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231226_211434__48500.047.87410[387, 821]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211434__485.json50.0missing{\n "num_gpu": 99\n}missing
683Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue420231226_115521__40700.021.37240[385, 349]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_115521__407.json50.0missing{\n "num_gpu": 99\n}missing
684Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue420231226_115557__45200.034.80830[385, 589]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_115557__452.json50.0missing{\n "num_gpu": 99\n}missing
685Apple-MacBook-Pro-M1add_yearmonthmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue420231226_211346__54400.035.3430[385, 602]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_211346__544.json50.0missing{\n "num_gpu": 99\n}missing
686Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse420231227_100331__53100.043.66270[83, 237]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_100331__531.json0.0missing{\n "num_gpu": 99\n}missing
687Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue420231227_100413__25610.042.13943[83, 246]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_100413__256.json75.0missing{\n "num_gpu": 99\n}missing
688Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue420231227_100451__99200.037.21260[83, 216]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_100451__992.json50.0missing{\n "num_gpu": 99\n}missing
689Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse420231227_140857__63800.037.08190[83, 214]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_140857__638.json0.0missing{\n "num_gpu": 99\n}missing
690Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue420231227_140955__31300.057.90090[83, 340]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_140955__313.json50.0missing{\n "num_gpu": 99\n}missing
691Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231227_100136__35300.036.65250[122, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_100136__353.json0.0missing{\n "num_gpu": 99\n}missing
692Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_100204__48310.028.55571[122, 149]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_100204__483.json62.5missing{\n "num_gpu": 99\n}missing
693Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_100246__67510.041.63021[122, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_100246__675.json62.5missing{\n "num_gpu": 99\n}missing
694Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue420231227_140807__98700.032.93590[122, 176]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_140807__987.json50.0missing{\n "num_gpu": 99\n}missing
695Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231227_140820__16600.011.72280[122, 53]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_140820__166.json0.0missing{\n "num_gpu": 99\n}missing
696Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_095754__62510.067.7431[248, 343]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095754__625.json62.5missing{\n "num_gpu": 99\n}missing
697Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_095949__33710.0114.6574[248, 645]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095949__337.json81.25missing{\n "num_gpu": 99\n}missing
698Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_100059__99410.068.98641[248, 369]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_100059__994.json62.5missing{\n "num_gpu": 99\n}missing
699Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231227_140627__89900.093.49550[248, 505]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_140627__899.json50.0missing{\n "num_gpu": 99\n}missing
700Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231227_140734__15600.066.34650[248, 346]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_140734__156.json25.0missing{\n "num_gpu": 99\n}missing
701Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_100858__53700.059.98750[396, 296]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_100858__537.json50.0missing{\n "num_gpu": 99\n}missing
702Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_101043__25200.0105.0070[396, 557]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101043__252.json50.0missing{\n "num_gpu": 99\n}missing
703Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231227_101207__40400.083.69383[396, 434]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101207__404.json68.75missing{\n "num_gpu": 99\n}missing
704Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse420231227_141410__97000.079.43010[396, 407]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_141410__970.json0.0missing{\n "num_gpu": 99\n}missing
705Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231227_141523__76200.073.43730[396, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_141523__762.json25.0missing{\n "num_gpu": 99\n}missing
706Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_100620__39700.089.48290[394, 468]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_100620__397.json50.0missing{\n "num_gpu": 99\n}missing
707Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_100644__46400.023.61611[394, 80]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_100644__464.json56.25missing{\n "num_gpu": 99\n}missing
708Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse420231227_100757__26100.073.24660[394, 374]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_100757__261.json0.0missing{\n "num_gpu": 99\n}missing
709Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue420231227_141057__87100.061.91350[394, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_141057__871.json50.0missing{\n "num_gpu": 99\n}missing
710Apple-MacBook-Pro-M1add_yearmonthnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse420231227_141250__75500.0112.7980[394, 598]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_141250__755.json25.0missing{\n "num_gpu": 99\n}missing
711Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse420231219_211319__31500.012.26690[66, 366]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_211319__315.json0.0missingmissingmissing
712Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse420231219_211334__22600.015.45070[1, 473]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_211334__226.json0.0missingmissingmissing
713Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse420231219_211342__18800.08.043810[1, 256]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_211342__188.json0.0missingmissingmissing
714Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse420231224_223545__71700.09.809860[84, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231224_223545__717.json0.0missing{\n "num_gpu": 99\n}missing
715Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse420231224_223554__45300.08.768130[84, 216]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231224_223554__453.json0.0missing{\n "num_gpu": 99\n}missing
716Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse420231219_211255__30200.011.88090[1, 370]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_211255__302.json0.0missingmissingmissing
717Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue420231219_211306__73000.011.32030[1, 353]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_211306__730.json50.0missingmissingmissing
718Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse420231224_223527__36300.012.72370[87, 318]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_223527__363.json0.0missing{\n "num_gpu": 99\n}missing
719Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue420231224_223535__96300.07.690950[87, 188]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_223535__963.json50.0missing{\n "num_gpu": 99\n}missing
720Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue420231226_211022__80200.015.80720[87, 395]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_211022__802.json50.0missing{\n "num_gpu": 99\n}missing
721Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_211221__78700.06.762870[1, 213]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_211221__787.json50.0missingmissingmissing
722Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_211228__86900.07.376540[1, 232]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_211228__869.json50.0missingmissingmissing
723Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue420231224_223507__95700.02.616610[129, 47]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223507__957.json50.0missing{\n "num_gpu": 99\n}missing
724Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_223515__97500.07.63590[129, 178]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_223515__975.json0.0missing{\n "num_gpu": 99\n}missing
725Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue420231226_211006__34500.02.629210[129, 47]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_211006__345.json50.0missing{\n "num_gpu": 99\n}missing
726Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231219_211156__10900.011.54190[1, 341]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211156__109.json0.0missingmissingmissing
727Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231219_211205__74100.09.713350[1, 289]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211205__741.json0.0missingmissingmissing
728Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_223445__77910.022.12324[256, 368]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223445__779.json81.25missing{\n "num_gpu": 99\n}missing
729Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_223504__13600.019.29820[256, 455]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223504__136.json50.0missing{\n "num_gpu": 99\n}missing
730Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse420231226_211003__42500.022.04890[256, 375]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211003__425.json25.0missing{\n "num_gpu": 99\n}missing
731Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231219_211525__38000.027.8430[1, 739]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211525__380.json50.0missingmissingmissing
732Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231219_211541__28000.016.56450[1, 459]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211541__280.json50.0missingmissingmissing
733Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223642__14600.018.21730[396, 402]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223642__146.json50.0missing{\n "num_gpu": 99\n}missing
734Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse420231224_223657__82500.014.9480[396, 321]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223657__825.json25.0missing{\n "num_gpu": 99\n}missing
735Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231226_211105__23010.020.23281[396, 449]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211105__230.json62.5missing{\n "num_gpu": 99\n}missing
736Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231219_211416__44200.014.59840[1, 408]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211416__442.json50.0missingmissingmissing
737Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231219_211438__77400.022.19190[1, 602]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_211438__774.json50.0missingmissingmissing
738Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_223611__14400.016.99020[394, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223611__144.json50.0missing{\n "num_gpu": 99\n}missing
739Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231224_223624__88000.012.78340[394, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223624__880.json50.0missing{\n "num_gpu": 99\n}missing
740Apple-MacBook-Pro-M1add_yearmonthopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_211044__11800.022.71220[394, 509]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_211044__118.json50.0missing{\n "num_gpu": 99\n}missing
741Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralAsIs1SHOTfalsefalse420231213_230409__83700.015.32140[66, 452]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231213_230409__837.json0.0missingmissingmissing
742Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralAsIs1SHOTfalsefalse420231224_214337__29300.013.61350[83, 437]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231224_214337__293.json0.0missing{\n "num_gpu": 99\n}missing
743Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralAsIs1SHOTfalsefalse420231224_214351__81600.013.66480[83, 438]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231224_214351__816.json0.0missing{\n "num_gpu": 99\n}missing
744Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTfalsefalse420231213_230354__16000.017.61940[82, 516]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_230354__160.json0.0missingmissingmissing
745Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruefalse420231224_214319__40900.06.577930[85, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_214319__409.json25.0missing{\n "num_gpu": 99\n}missing
746Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruetrue420231224_214323__87700.04.527940[85, 138]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_214323__877.json50.0missing{\n "num_gpu": 99\n}missing
747Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralInJulia1SHOTtruetrue420231226_204611__83700.07.67410[85, 242]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_204611__837.json50.0missing{\n "num_gpu": 99\n}missing
748Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse420231213_230336__99900.07.709550[112, 217]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_230336__999.json25.0missingmissingmissing
749Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue420231224_214309__83900.02.980360[127, 80]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_214309__839.json50.0missing{\n "num_gpu": 99\n}missing
750Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue420231224_214312__14700.03.0110[127, 82]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_214312__147.json50.0missing{\n "num_gpu": 99\n}missing
751Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue420231226_204604__80200.06.271060[127, 190]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_204604__802.json50.0missing{\n "num_gpu": 99\n}missing
752Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231213_230329__97300.020.15130[239, 520]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230329__973.json50.0missingmissingmissing
753Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231224_214246__90000.025.2250[254, 599]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214246__900.json50.0missing{\n "num_gpu": 99\n}missing
754Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231224_214306__89610.019.67351[254, 591]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214306__896.json62.5missing{\n "num_gpu": 99\n}missing
755Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue420231226_204557__17110.021.13931[254, 467]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204557__171.json62.5missing{\n "num_gpu": 99\n}missing
756Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue420231213_230444__37800.015.10270[11, 410]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230444__378.json50.0missingmissingmissing
757Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue420231224_214422__87510.013.54871[394, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214422__875.json62.5missing{\n "num_gpu": 99\n}missing
758Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue420231224_214441__87210.018.73651[394, 531]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214441__872.json62.5missing{\n "num_gpu": 99\n}missing
759Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse420231226_204649__75600.022.17080[394, 632]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_204649__756.json0.0missing{\n "num_gpu": 99\n}missing
760Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue420231213_230429__15000.019.0490[383, 429]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_230429__150.json50.0missingmissingmissing
761Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse420231224_214402__95400.011.06130[392, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_214402__954.json0.0missing{\n "num_gpu": 99\n}missing
762Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue420231224_214408__96300.06.545060[392, 152]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_214408__963.json50.0missing{\n "num_gpu": 99\n}missing
763Apple-MacBook-Pro-M1add_yearmonthopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse420231226_204626__84500.014.80770[392, 410]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_204626__845.json25.0missing{\n "num_gpu": 99\n}missing
764Apple-MacBook-Pro-M1add_yearmonthorca2:13bAsIs1SHOTfalsefalse420231213_231443__11800.011.75120[66, 349]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__AsIs__1SHOT__20231213_231443__118.json0.0missingmissingmissing
765Apple-MacBook-Pro-M1add_yearmonthorca2:13bAsIs1SHOTfalsefalse420231224_220615__75500.010.23550[83, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__AsIs__1SHOT__20231224_220615__755.json0.0missing{\n "num_gpu": 99\n}missing
766Apple-MacBook-Pro-M1add_yearmonthorca2:13bAsIs1SHOTfalsefalse420231224_220635__96500.020.33890[83, 368]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__AsIs__1SHOT__20231224_220635__965.json0.0missing{\n "num_gpu": 99\n}missing
767Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTtruefalse420231213_231431__56700.012.95470[82, 383]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231213_231431__567.json25.0missingmissingmissing
768Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTtruetrue420231224_220602__83100.07.324480[85, 125]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231224_220602__831.json50.0missing{\n "num_gpu": 99\n}missing
769Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTfalsefalse420231224_220605__36600.02.84980[85, 39]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231224_220605__366.json0.0missing{\n "num_gpu": 99\n}missing
770Apple-MacBook-Pro-M1add_yearmonthorca2:13bInJulia1SHOTtruetrue420231226_205626__60000.09.09470[85, 159]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__InJulia__1SHOT__20231226_205626__600.json50.0missing{\n "num_gpu": 99\n}missing
771Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTtruefalse420231213_231418__39600.06.750850[112, 188]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231213_231418__396.json25.0missingmissingmissing
772Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTfalsefalse420231224_220534__59600.017.84130[125, 316]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_220534__596.json0.0missing{\n "num_gpu": 99\n}missing
773Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTfalsefalse420231224_220554__42700.020.45190[125, 363]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_220554__427.json0.0missing{\n "num_gpu": 99\n}missing
774Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertAsk1SHOTfalsefalse420231226_205616__70100.03.435880[125, 46]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_205616__701.json0.0missing{\n "num_gpu": 99\n}missing
775Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTtruetrue420231213_231412__83600.014.24970[239, 361]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231412__836.json50.0missingmissingmissing
776Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTfalsefalse420231224_220511__30400.020.72750[252, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220511__304.json0.0missing{\n "num_gpu": 99\n}missing
777Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTfalsefalse420231224_220516__61700.05.419930[252, 63]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220516__617.json0.0missing{\n "num_gpu": 99\n}missing
778Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaExpertCoTTask1SHOTfalsefalse420231226_205613__71000.026.08480[252, 258]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205613__710.json0.0missing{\n "num_gpu": 99\n}missing
779Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231213_231529__66800.019.53130[11, 528]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231529__668.json0.0missingmissingmissing
780Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231224_220741__11800.017.42910[389, 255]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220741__118.json0.0missing{\n "num_gpu": 99\n}missing
781Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231224_220846__64500.064.98730[389, 1045]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220846__645.json0.0missing{\n "num_gpu": 99\n}missing
782Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapCoTTask1SHOTfalsefalse420231226_205714__44500.015.05330[389, 214]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205714__445.json0.0missing{\n "num_gpu": 99\n}missing
783Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTtruefalse420231213_231509__77500.026.22220[383, 614]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231213_231509__775.json25.0missingmissingmissing
784Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTfalsefalse420231224_220658__51900.023.10720[386, 355]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_220658__519.json0.0missing{\n "num_gpu": 99\n}missing
785Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTfalsefalse420231224_220724__63200.025.25520[386, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_220724__632.json0.0missing{\n "num_gpu": 99\n}missing
786Apple-MacBook-Pro-M1add_yearmonthorca2:13bJuliaRecapTask1SHOTtruetrue420231226_205659__32600.033.32490[386, 533]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_205659__326.json50.0missing{\n "num_gpu": 99\n}missing
787Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse420231219_211756__70300.09.521280[66, 285]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_211756__703.json0.0missingmissingmissing
788Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse420231219_211807__95900.010.52850[1, 330]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_211807__959.json0.0missingmissingmissing
789Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse420231219_211816__21100.09.180070[1, 290]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_211816__211.json0.0missingmissingmissing
790Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse420231224_223813__94600.03.814430[76, 144]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231224_223813__946.json0.0missing{\n "num_gpu": 99\n}missing
791Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse420231224_223817__49000.04.407740[76, 168]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231224_223817__490.json0.0missing{\n "num_gpu": 99\n}missing
792Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse420231219_211727__30700.09.126110[1, 288]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_211727__307.json0.0missingmissingmissing
793Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTtruetrue420231219_211747__48900.020.00430[1, 599]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_211747__489.json50.0missingmissingmissing
794Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTtruetrue420231224_223744__58100.04.14680[79, 157]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_223744__581.json50.0missing{\n "num_gpu": 99\n}missing
795Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse420231224_223809__37500.024.60850[79, 909]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_223809__375.json0.0missing{\n "num_gpu": 99\n}missing
796Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse420231226_211146__40700.012.86380[79, 491]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_211146__407.json0.0missing{\n "num_gpu": 99\n}missing
797Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruefalse420231219_211651__20700.010.95840[1, 338]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_211651__207.json25.0missingmissingmissing
798Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue420231219_211657__78500.05.712020[1, 181]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_211657__785.json50.0missingmissingmissing
799Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse420231224_223736__31900.030.89220[116, 1108]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_223736__319.json0.0missing{\n "num_gpu": 99\n}missing
800Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse420231224_223740__77900.04.632290[116, 172]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_223740__779.json0.0missing{\n "num_gpu": 99\n}missing
801Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse420231226_211133__32000.020.20410[116, 747]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_211133__320.json0.0missing{\n "num_gpu": 99\n}missing
802Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue420231219_211612__27900.011.57340[1, 342]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211612__279.json50.0missingmissingmissing
803Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse420231219_211633__58600.020.57120[1, 584]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_211633__586.json25.0missingmissingmissing
804Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231224_223702__67100.05.116840[228, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223702__671.json0.0missing{\n "num_gpu": 99\n}missing
805Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231224_223705__84700.02.445810[228, 68]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223705__847.json0.0missing{\n "num_gpu": 99\n}missing
806Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse420231226_211113__50100.07.950070[228, 147]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211113__501.json0.0missing{\n "num_gpu": 99\n}missing
807Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse420231219_211943__28600.015.82210[1, 440]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_211943__286.json25.0missingmissingmissing
808Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue420231219_212000__72100.016.71870[1, 463]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_212000__721.json50.0missingmissingmissing
809Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231224_223854__42500.06.445990[368, 199]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223854__425.json0.0missing{\n "num_gpu": 99\n}missing
810Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231224_223919__84500.024.81880[368, 837]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223919__845.json0.0missing{\n "num_gpu": 99\n}missing
811Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse420231226_211159__40600.012.07250[368, 402]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211159__406.json0.0missing{\n "num_gpu": 99\n}missing
812Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruefalse420231219_211855__98100.020.46160[1, 559]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_211855__981.json25.0missingmissingmissing
813Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue420231219_211911__49500.015.55110[1, 433]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_211911__495.json50.0missingmissingmissing
814Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse420231224_223824__98600.06.92730[365, 212]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_223824__986.json0.0missing{\n "num_gpu": 99\n}missing
815Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse420231224_223847__87600.023.20360[365, 783]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_223847__876.json0.0missing{\n "num_gpu": 99\n}missing
816Apple-MacBook-Pro-M1add_yearmonthphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse420231226_211147__23300.01.234760[365, 1]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_211147__233.json0.0missing{\n "num_gpu": 99\n}missing
817Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2AsIs1SHOTfalsefalse420231213_231624__64700.014.77310[66, 437]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231213_231624__647.json0.0missingmissingmissing
818Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2AsIs1SHOTfalsefalse420231224_221335__14800.027.30020[91, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231224_221335__148.json0.0missing{\n "num_gpu": 99\n}missing
819Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2AsIs1SHOTfalsefalse420231224_221426__53600.050.80910[91, 393]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231224_221426__536.json0.0missing{\n "num_gpu": 99\n}missing
820Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTtruetrue420231213_231609__69500.015.6380[82, 460]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231213_231609__695.json50.0missingmissingmissing
821Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTtruetrue420231224_221158__25400.038.65560[93, 297]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_221158__254.json50.0missing{\n "num_gpu": 99\n}missing
822Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTfalsefalse420231224_221307__19800.068.69030[93, 531]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_221307__198.json0.0missing{\n "num_gpu": 99\n}missing
823Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2InJulia1SHOTfalsefalse420231226_205944__53500.041.83970[93, 319]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_205944__535.json0.0missing{\n "num_gpu": 99\n}missing
824Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231213_231553__91300.07.786180[112, 219]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231213_231553__913.json50.0missingmissingmissing
825Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231224_221033__34410.012.00451[133, 72]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_221033__344.json62.5missing{\n "num_gpu": 99\n}missing
826Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231224_221119__39410.045.53813[133, 341]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_221119__394.json75.0missing{\n "num_gpu": 99\n}missing
827Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue420231226_205901__52510.039.96381[133, 297]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_205901__525.json62.5missing{\n "num_gpu": 99\n}missing
828Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse420231213_231545__74400.016.25760[239, 416]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231545__744.json25.0missingmissingmissing
829Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue420231224_220950__61210.063.93634[260, 282]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220950__612.json81.25missing{\n "num_gpu": 99\n}missing
830Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue420231224_221021__79210.030.52284[260, 198]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_221021__792.json81.25missing{\n "num_gpu": 99\n}missing
831Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue420231226_205821__85500.066.97190[260, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205821__855.json50.0missing{\n "num_gpu": 99\n}missing
832Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse420231213_231708__42200.021.92830[11, 587]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231708__422.json0.0missingmissingmissing
833Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse420231224_221730__17400.047.39130[397, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_221730__174.json25.0missing{\n "num_gpu": 99\n}missing
834Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue420231224_221757__86810.026.34793[397, 141]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_221757__868.json75.0missing{\n "num_gpu": 99\n}missing
835Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue420231226_210127__77910.046.2013[397, 296]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210127__779.json75.0missing{\n "num_gpu": 99\n}missing
836Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse420231213_231646__45400.022.40590[383, 518]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231213_231646__454.json0.0missingmissingmissing
837Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue420231224_221538__11200.071.82180[394, 492]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_221538__112.json50.0missing{\n "num_gpu": 99\n}missing
838Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue420231224_221642__39300.063.94710[394, 432]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_221642__393.json50.0missing{\n "num_gpu": 99\n}missing
839Apple-MacBook-Pro-M1add_yearmonthphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse420231226_210041__39500.056.95330[394, 379]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_210041__395.json25.0missing{\n "num_gpu": 99\n}missing
840Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse420231219_210418__99000.017.69660[66, 521]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_210418__990.json0.0missingmissingmissing
841Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse420231219_210433__42700.014.38340[1, 442]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_210433__427.json0.0missingmissingmissing
842Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse420231219_210446__97300.013.02650[1, 404]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_210446__973.json0.0missingmissingmissing
843Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse420231224_223032__53600.017.17810[85, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231224_223032__536.json0.0missing{\n "num_gpu": 99\n}missing
844Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse420231224_223048__34300.015.74150[85, 264]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231224_223048__343.json0.0missing{\n "num_gpu": 99\n}missing
845Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue420231219_210350__14900.011.36690[1, 355]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_210350__149.json50.0missingmissingmissing
846Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue420231219_210401__52900.010.51930[1, 330]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_210401__529.json50.0missingmissingmissing
847Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse420231224_223004__85100.016.61180[87, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_223004__851.json25.0missing{\n "num_gpu": 99\n}missing
848Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue420231224_223015__98010.010.24731[87, 168]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_223015__980.json62.5missing{\n "num_gpu": 99\n}missing
849Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue420231226_210750__45910.015.92491[87, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_210750__459.json62.5missing{\n "num_gpu": 99\n}missing
850Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_210317__74300.05.791130[1, 184]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210317__743.json50.0missingmissingmissing
851Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue420231219_210326__70600.08.974850[1, 280]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_210326__706.json50.0missingmissingmissing
852Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue420231224_222931__46200.012.4660[129, 198]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222931__462.json50.0missing{\n "num_gpu": 99\n}missing
853Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231224_222948__79300.017.02550[129, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_222948__793.json0.0missing{\n "num_gpu": 99\n}missing
854Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse420231226_210734__78900.012.18070[129, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_210734__789.json0.0missing{\n "num_gpu": 99\n}missing
855Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231219_210253__10100.016.95360[1, 489]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210253__101.json50.0missingmissingmissing
856Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231219_210305__72500.011.39490[1, 337]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_210305__725.json0.0missingmissingmissing
857Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse420231224_222859__31000.034.21450[256, 388]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_222859__310.json0.0missing{\n "num_gpu": 99\n}missing
858Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231224_222918__56500.018.65820[256, 288]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_222918__565.json50.0missing{\n "num_gpu": 99\n}missing
859Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue420231226_210721__58300.036.58230[256, 444]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_210721__583.json50.0missing{\n "num_gpu": 99\n}missing
860Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231219_210626__36300.022.32060[1, 605]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210626__363.json50.0missingmissingmissing
861Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231219_210645__52000.019.60910[1, 537]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_210645__520.json50.0missingmissingmissing
862Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223201__48800.019.02670[396, 269]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223201__488.json50.0missing{\n "num_gpu": 99\n}missing
863Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231224_223220__77200.018.40850[396, 259]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_223220__772.json50.0missing{\n "num_gpu": 99\n}missing
864Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue420231226_210835__62100.018.83880[396, 266]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_210835__621.json50.0missing{\n "num_gpu": 99\n}missing
865Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231219_210527__28900.023.57550[1, 636]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210527__289.json0.0missingmissingmissing
866Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231219_210539__22600.011.85520[1, 335]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_210539__226.json0.0missingmissingmissing
867Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231224_223115__16900.026.98970[394, 401]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223115__169.json0.0missing{\n "num_gpu": 99\n}missing
868Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse420231224_223142__96100.027.2660[394, 406]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_223142__961.json0.0missing{\n "num_gpu": 99\n}missing
869Apple-MacBook-Pro-M1add_yearmonthsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue420231226_210816__34000.026.57010[394, 394]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_210816__340.json50.0missing{\n "num_gpu": 99\n}missing
870Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrAsIs1SHOTfalsefalse420231213_231313__76900.019.32120[66, 564]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__AsIs__1SHOT__20231213_231313__769.json0.0missingmissingmissing
871Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrAsIs1SHOTfalsefalse420231224_220418__13300.05.561690[85, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__AsIs__1SHOT__20231224_220418__133.json0.0missing{\n "num_gpu": 99\n}missing
872Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrAsIs1SHOTfalsefalse420231224_220422__82200.04.399780[85, 248]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__AsIs__1SHOT__20231224_220422__822.json0.0missing{\n "num_gpu": 99\n}missing
873Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTfalsefalse420231213_231254__18800.010.11450[82, 299]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231213_231254__188.json0.0missingmissingmissing
874Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTtruetrue420231224_220404__64000.05.898680[88, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_220404__640.json50.0missing{\n "num_gpu": 99\n}missing
875Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTfalsefalse420231224_220412__70600.07.520910[88, 422]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_220412__706.json0.0missing{\n "num_gpu": 99\n}missing
876Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrInJulia1SHOTtruetrue420231226_205530__75700.05.227820[88, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_205530__757.json50.0missing{\n "num_gpu": 99\n}missing
877Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTtruetrue420231213_231244__31800.07.075030[112, 197]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231213_231244__318.json50.0missingmissingmissing
878Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTtruetrue420231224_220353__40300.04.950090[125, 273]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_220353__403.json50.0missing{\n "num_gpu": 99\n}missing
879Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse420231224_220359__78900.05.22960[125, 288]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_220359__789.json0.0missing{\n "num_gpu": 99\n}missing
880Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertAsk1SHOTtruetrue420231226_205524__72100.01.826970[125, 92]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_205524__721.json50.0missing{\n "num_gpu": 99\n}missing
881Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue420231213_231237__29800.020.170[239, 522]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231237__298.json50.0missingmissingmissing
882Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue420231224_220339__30400.015.56420[232, 646]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220339__304.json50.0missing{\n "num_gpu": 99\n}missing
883Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse420231224_220348__59300.08.725320[232, 445]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_220348__593.json0.0missing{\n "num_gpu": 99\n}missing
884Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse420231226_205523__76000.09.481930[232, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_205523__760.json0.0missing{\n "num_gpu": 99\n}missing
885Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231213_231357__11000.019.66350[11, 531]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231357__110.json0.0missingmissingmissing
886Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231224_220440__33900.05.623580[375, 247]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220440__339.json0.0missing{\n "num_gpu": 99\n}missing
887Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231224_220450__61500.09.69120[375, 454]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_220450__615.json0.0missing{\n "num_gpu": 99\n}missing
888Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse420231226_205547__15100.010.6740[375, 502]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205547__151.json0.0missing{\n "num_gpu": 99\n}missing
889Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTtruetrue420231213_231337__26800.024.2090[383, 563]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231213_231337__268.json50.0missingmissingmissing
890Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTfalsefalse420231224_220429__73700.06.853570[373, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_220429__737.json0.0missing{\n "num_gpu": 99\n}missing
891Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTfalsefalse420231224_220435__54900.05.62920[373, 248]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_220435__549.json0.0missing{\n "num_gpu": 99\n}missing
892Apple-MacBook-Pro-M1add_yearmonthstablelm-zephyrJuliaRecapTask1SHOTfalsefalse420231226_205536__90200.06.429830[373, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_205536__902.json0.0missing{\n "num_gpu": 99\n}missing
893Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestAsIs1SHOTfalsefalse420231213_230530__99500.013.21350[66, 393]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__AsIs__1SHOT__20231213_230530__995.json0.0missingmissingmissing
894Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestAsIs1SHOTfalsefalse420231224_214610__30300.05.261930[84, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__AsIs__1SHOT__20231224_214610__303.json0.0missing{\n "num_gpu": 99\n}missing
895Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestAsIs1SHOTfalsefalse420231224_214620__66700.09.949920[84, 316]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__AsIs__1SHOT__20231224_214620__667.json0.0missing{\n "num_gpu": 99\n}missing
896Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231213_230516__55000.010.74840[82, 319]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_230516__550.json50.0missingmissingmissing
897Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231224_214559__80000.07.974350[87, 251]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_214559__800.json50.0missing{\n "num_gpu": 99\n}missing
898Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231224_214604__29300.05.462090[87, 169]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_214604__293.json50.0missing{\n "num_gpu": 99\n}missing
899Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestInJulia1SHOTtruetrue420231226_204732__98300.013.19530[87, 421]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_204732__983.json50.0missing{\n "num_gpu": 99\n}missing
900Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruefalse420231213_230506__91000.06.417890[112, 178]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_230506__910.json25.0missingmissingmissing
901Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruetrue420231224_214544__13600.015.42120[129, 483]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_214544__136.json50.0missing{\n "num_gpu": 99\n}missing
902Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruetrue420231224_214551__13600.06.497530[129, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_214551__136.json50.0missing{\n "num_gpu": 99\n}missing
903Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertAsk1SHOTtruetrue420231226_204718__91700.08.157320[129, 248]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_204718__917.json50.0missing{\n "num_gpu": 99\n}missing
904Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse420231213_230459__31900.015.16550[239, 385]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230459__319.json0.0missingmissingmissing
905Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue420231224_214512__97100.031.19721[256, 768]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214512__971.json56.25missing{\n "num_gpu": 99\n}missing
906Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue420231224_214528__43300.015.59940[256, 466]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214528__433.json50.0missing{\n "num_gpu": 99\n}missing
907Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue420231226_204710__17900.021.59970[256, 486]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204710__179.json50.0missing{\n "num_gpu": 99\n}missing
908Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse420231213_230604__46900.011.78430[11, 327]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230604__469.json0.0missingmissingmissing
909Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue420231224_214704__59500.015.72350[396, 439]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214704__595.json50.0missing{\n "num_gpu": 99\n}missing
910Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue420231224_214712__55900.07.485271[396, 182]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_214712__559.json56.25missing{\n "num_gpu": 99\n}missing
911Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue420231226_204803__26210.019.96721[396, 566]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_204803__262.json62.5missing{\n "num_gpu": 99\n}missing
912Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231213_230552__35100.022.64180[383, 526]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_230552__351.json50.0missingmissingmissing
913Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231224_214634__68700.013.53550[394, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_214634__687.json50.0missing{\n "num_gpu": 99\n}missing
914Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231224_214648__65000.014.29570[394, 395]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_214648__650.json50.0missing{\n "num_gpu": 99\n}missing
915Apple-MacBook-Pro-M1add_yearmonthstarling-lm:latestJuliaRecapTask1SHOTtruetrue420231226_204743__23600.010.37340[394, 272]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_204743__236.json50.0missing{\n "num_gpu": 99\n}missing
916Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatAsIs1SHOTfalsefalse420231213_230648__27600.012.82640[66, 382]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__AsIs__1SHOT__20231213_230648__276.json0.0missingmissingmissing
917Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatAsIs1SHOTfalsefalse420231224_215226__89200.067.4690[80, 504]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__AsIs__1SHOT__20231224_215226__892.json0.0missing{\n "num_gpu": 99\n}missing
918Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatAsIs1SHOTfalsefalse420231224_215303__81700.036.94970[80, 273]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__AsIs__1SHOT__20231224_215303__817.json0.0missing{\n "num_gpu": 99\n}missing
919Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTfalsefalse420231213_230635__77300.017.80710[82, 522]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_230635__773.json0.0missingmissingmissing
920Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruefalse420231224_214941__94100.036.29420[83, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_214941__941.json25.0missing{\n "num_gpu": 99\n}missing
921Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruetrue420231224_215118__49900.096.60470[83, 719]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_215118__499.json50.0missing{\n "num_gpu": 99\n}missing
922Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatInJulia1SHOTtruefalse420231226_204956__29800.041.05590[83, 302]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_204956__298.json25.0missing{\n "num_gpu": 99\n}missing
923Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231213_230617__42300.05.680540[112, 154]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_230617__423.json50.0missingmissingmissing
924Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231224_214840__70500.09.995070[122, 58]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_214840__705.json50.0missing{\n "num_gpu": 99\n}missing
925Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231224_214904__52110.024.03011[122, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_214904__521.json62.5missing{\n "num_gpu": 99\n}missing
926Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertAsk1SHOTtruetrue420231226_204914__19510.09.227831[122, 52]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_204914__195.json62.5missing{\n "num_gpu": 99\n}missing
927Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse420231213_230612__17400.07.557650[239, 171]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_230612__174.json25.0missingmissingmissing
928Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse420231224_214806__89100.053.85690[248, 159]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214806__891.json25.0missing{\n "num_gpu": 99\n}missing
929Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse420231224_214830__40700.024.40470[248, 148]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_214830__407.json0.0missing{\n "num_gpu": 99\n}missing
930Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse420231226_204905__34900.062.15040[248, 242]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_204905__349.json0.0missing{\n "num_gpu": 99\n}missing
931Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue420231213_230726__17000.019.35070[11, 519]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_230726__170.json50.0missingmissingmissing
932Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue420231224_215516__99000.037.85410[396, 221]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215516__990.json50.0missing{\n "num_gpu": 99\n}missing
933Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse420231224_215614__18900.057.43870[396, 365]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_215614__189.json25.0missing{\n "num_gpu": 99\n}missing
934Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse420231226_205220__65600.052.98140[396, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_205220__656.json25.0missing{\n "num_gpu": 99\n}missing
935Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTfalsefalse420231213_230707__42800.018.69630[383, 424]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_230707__428.json0.0missingmissingmissing
936Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTtruefalse420231224_215356__67700.053.34730[394, 336]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_215356__677.json25.0missing{\n "num_gpu": 99\n}missing
937Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTtruetrue420231224_215438__23710.041.67871[394, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_215438__237.json62.5missing{\n "num_gpu": 99\n}missing
938Apple-MacBook-Pro-M1add_yearmonthyi:34b-chatJuliaRecapTask1SHOTtruefalse420231226_205127__55100.090.47670[394, 600]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/add_yearmonth/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_205127__551.json25.0missing{\n "num_gpu": 99\n}missing
939Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200148__30150.0002791.165152[102, 152]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200148__301.json100.0missingmissingmissing
940Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125InJulia1SHOTtruefalse520240201_200150__67400.0004471.841130[102, 264]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200150__674.json25.0missingmissingmissing
941Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200152__69000.00040651.880780[102, 237]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200152__690.json50.0missingmissingmissing
942Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200153__58850.0002521.11492[102, 134]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200153__588.json100.0missingmissingmissing
943Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200154__41100.0002431.220910[102, 128]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200154__411.json50.0missingmissingmissing
944Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200142__65000.00018850.783730[137, 80]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200142__650.json50.0missingmissingmissing
945Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200143__41300.00018550.9656840[137, 78]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200143__413.json50.0missingmissingmissing
946Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200144__91000.00019750.7646640[137, 86]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200144__910.json50.0missingmissingmissing
947Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200145__70500.00017650.7433740[137, 72]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200145__705.json50.0missingmissingmissing
948Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200146__10900.00021851.075410[137, 100]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200146__109.json50.0missingmissingmissing
949Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200135__36900.0003861.465360[283, 163]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200135__369.json25.0missingmissingmissing
950Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200137__47900.0003891.392830[283, 165]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200137__479.json25.0missingmissingmissing
951Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200138__45200.0003891.418040[283, 165]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200138__452.json25.0missingmissingmissing
952Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200140__38250.00038451.502872[283, 162]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200140__382.json100.0missingmissingmissing
953Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200141__69000.00040251.421320[283, 174]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200141__690.json25.0missingmissingmissing
954Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200200__86800.00037051.004780[360, 127]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200200__868.json50.0missingmissingmissing
955Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200202__85950.00037351.02742[360, 129]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200202__859.json100.0missingmissingmissing
956Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200203__38000.0003481.132870[360, 112]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200203__380.json50.0missingmissingmissing
957Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200204__82250.00029850.8387362[360, 79]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200204__822.json100.0missingmissingmissing
958Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200205__77300.0004861.487541[360, 204]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200205__773.json62.5missingmissingmissing
959Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200155__37800.0003131.033430[359, 89]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200155__378.json50.0missingmissingmissing
960Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200156__26200.00028750.9271450[359, 72]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200156__262.json50.0missingmissingmissing
961Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200157__49200.00033550.9500711[359, 104]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200157__492.json62.5missingmissingmissing
962Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200158__76350.0002890.7293282[359, 73]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200158__763.json100.0missingmissingmissing
963Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200159__89050.00035351.009482[359, 116]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200159__890.json100.0missingmissingmissing
964Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewInJulia1SHOTtruetrue520240201_070652__52700.012626.20730[102, 386]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_070652__527.json50.0missingmissingmissing
965Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewInJulia1SHOTtruetrue520240201_070712__27600.0152420.03350[102, 474]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_070712__276.json50.0missingmissingmissing
966Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewInJulia1SHOTtruetrue520240201_070748__86500.0168635.24710[102, 528]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_070748__865.json50.0missingmissingmissing
967Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewInJulia1SHOTtruetrue520240201_070825__46300.0163537.37260[102, 511]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_070825__463.json50.0missingmissingmissing
968Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewInJulia1SHOTtruefalse520240201_070855__73900.013529.98030[102, 416]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_070855__739.json25.0missingmissingmissing
969Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_070240__77000.0049110.64160[137, 118]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_070240__770.json50.0missingmissingmissing
970Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_070252__22700.0040411.04230[137, 89]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_070252__227.json50.0missingmissingmissing
971Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_070301__92300.004648.755090[137, 109]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_070301__923.json50.0missingmissingmissing
972Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_070310__53300.004259.287410[137, 96]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_070310__533.json50.0missingmissingmissing
973Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_070320__14600.004710.0070[137, 111]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_070320__146.json50.0missingmissingmissing
974Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_065849__12500.0165461.49660[283, 457]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_065849__125.json25.0missingmissingmissing
975Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_065926__74000.0164237.0680[283, 453]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_065926__740.json50.0missingmissingmissing
976Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_070005__35500.0165138.69340[283, 456]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_070005__355.json50.0missingmissingmissing
977Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_070047__94600.017841.69970[283, 499]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_070047__946.json25.0missingmissingmissing
978Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_070126__94900.0140838.66670[283, 375]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_070126__949.json25.0missingmissingmissing
979Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_071839__17000.018332.44170[360, 490]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_071839__170.json50.0missingmissingmissing
980Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_071916__48900.0177636.25440[360, 472]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_071916__489.json50.0missingmissingmissing
981Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_071957__69000.0158440.93660[360, 408]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_071957__690.json50.0missingmissingmissing
982Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_072048__38200.0186651.04120[360, 502]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_072048__382.json50.0missingmissingmissing
983Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_072122__43400.0174633.2850[360, 462]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_072122__434.json50.0missingmissingmissing
984Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_071247__61300.0184133.56490[359, 494]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_071247__613.json50.0missingmissingmissing
985Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_071318__33500.0159529.69650[359, 412]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_071318__335.json50.0missingmissingmissing
986Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_071405__49900.0206346.80690[359, 568]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_071405__499.json50.0missingmissingmissing
987Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_071451__94500.0159846.30190[359, 413]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_071451__945.json50.0missingmissingmissing
988Apple-MacBook-Pro-M1audi_filtergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_071527__31000.0170335.4570[359, 448]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/audi_filter/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_071527__310.json50.0missingmissingmissing
989Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructAsIs1SHOTfalsefalse520231213_232532__25100.017.83880[95, 515]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231213_232532__251.json0.0missingmissingmissing
990Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructAsIs1SHOTfalsefalse520231224_225950__24600.06.245790[117, 100]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231224_225950__246.json0.0missing{\n "num_gpu": 99\n}missing
991Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructAsIs1SHOTfalsefalse520231224_230003__79700.013.45430[117, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231224_230003__797.json0.0missing{\n "num_gpu": 99\n}missing
992Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruefalse520231213_232514__95800.013.3190[112, 384]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231213_232514__958.json25.0missingmissingmissing
993Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruetrue520231224_225931__25300.013.55630[120, 238]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_225931__253.json50.0missing{\n "num_gpu": 99\n}missing
994Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruetrue520231224_225944__36200.012.45070[120, 217]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231224_225944__362.json50.0missing{\n "num_gpu": 99\n}missing
995Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructInJulia1SHOTtruetrue520231226_212420__78600.015.40320[120, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_212420__786.json50.0missing{\n "num_gpu": 99\n}missing
996Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231213_232501__56900.011.78510[141, 328]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231213_232501__569.json0.0missingmissingmissing
997Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231224_225911__41250.013.31112[158, 227]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_225911__412.json100.0missing{\n "num_gpu": 99\n}missing
998Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231224_225917__40800.05.563460[158, 81]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231224_225917__408.json0.0missing{\n "num_gpu": 99\n}missing
999Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_212404__49600.013.5110[158, 217]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_212404__496.json50.0missing{\n "num_gpu": 99\n}missing
1000Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231213_232449__11900.015.37340[311, 364]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232449__119.json0.0missingmissingmissing
1001Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231224_225851__50050.024.29622[329, 212]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_225851__500.json100.0missing{\n "num_gpu": 99\n}missing
1002Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231224_225858__27700.06.744980[329, 73]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231224_225858__277.json0.0missing{\n "num_gpu": 99\n}missing
1003Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_212350__45000.021.26140[329, 161]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212350__450.json0.0missing{\n "num_gpu": 99\n}missing
1004Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231213_232613__12000.020.3920[11, 544]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232613__120.json50.0missingmissingmissing
1005Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231224_230133__76200.036.47960[423, 579]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230133__762.json50.0missing{\n "num_gpu": 99\n}missing
1006Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231224_230157__87100.022.77690[423, 345]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230157__871.json25.0missing{\n "num_gpu": 99\n}missing
1007Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_212512__30300.016.20210[423, 220]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212512__303.json50.0missing{\n "num_gpu": 99\n}missing
1008Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231213_232553__61300.020.28370[412, 450]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231213_232553__613.json50.0missingmissingmissing
1009Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231224_230032__82500.028.58270[420, 446]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_230032__825.json0.0missing{\n "num_gpu": 99\n}missing
1010Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231224_230057__21300.024.85350[420, 382]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231224_230057__213.json50.0missing{\n "num_gpu": 99\n}missing
1011Apple-MacBook-Pro-M1audi_filtercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_212456__77400.035.59770[420, 545]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_212456__774.json50.0missing{\n "num_gpu": 99\n}missing
1012NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203615__56300.02.723770[0, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203615__563.json50.0missing{\n "num_gpu": 99\n}missing
1013NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203619__26150.02.906432[0, 223]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203619__261.json100.0missing{\n "num_gpu": 99\n}missing
1014NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203623__53900.04.597610[0, 351]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203623__539.json50.0missing{\n "num_gpu": 99\n}missing
1015NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203627__43100.03.695390[0, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203627__431.json50.0missing{\n "num_gpu": 99\n}missing
1016NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203631__62200.03.337450[0, 256]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203631__622.json50.0missing{\n "num_gpu": 99\n}missing
1017NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_203550__27300.01.014230[0, 78]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203550__273.json0.0missing{\n "num_gpu": 99\n}missing
1018NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_203551__50800.01.208950[0, 93]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203551__508.json0.0missing{\n "num_gpu": 99\n}missing
1019NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_203554__15800.02.664320[0, 204]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203554__158.json50.0missing{\n "num_gpu": 99\n}missing
1020NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240131_203556__82300.02.099490[0, 160]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203556__823.json25.0missing{\n "num_gpu": 99\n}missing
1021NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_203557__36700.01.340610[0, 103]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203557__367.json50.0missing{\n "num_gpu": 99\n}missing
1022NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_203533__41000.02.987470[0, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203533__410.json50.0missing{\n "num_gpu": 99\n}missing
1023NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203535__41400.01.863190[0, 141]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203535__414.json0.0missing{\n "num_gpu": 99\n}missing
1024NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203537__70000.01.689650[0, 128]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203537__700.json0.0missing{\n "num_gpu": 99\n}missing
1025NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203538__35100.01.132840[0, 86]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203538__351.json0.0missing{\n "num_gpu": 99\n}missing
1026NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_203540__85900.01.836810[0, 139]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203540__859.json25.0missing{\n "num_gpu": 99\n}missing
1027NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_203736__67600.04.332740[0, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203736__676.json50.0missing{\n "num_gpu": 99\n}missing
1028NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_203739__80400.03.289480[0, 245]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203739__804.json50.0missing{\n "num_gpu": 99\n}missing
1029NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_203743__79300.03.561940[0, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203743__793.json50.0missing{\n "num_gpu": 99\n}missing
1030NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_203746__77350.03.029752[0, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203746__773.json100.0missing{\n "num_gpu": 99\n}missing
1031NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_203751__50440.04.589232[0, 341]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203751__504.json95.0missing{\n "num_gpu": 99\n}missing
1032NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203701__59300.03.100650[0, 231]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203701__593.json50.0missing{\n "num_gpu": 99\n}missing
1033NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_203703__85800.01.779750[0, 133]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203703__858.json0.0missing{\n "num_gpu": 99\n}missing
1034NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203707__93700.04.542490[0, 337]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203707__937.json50.0missing{\n "num_gpu": 99\n}missing
1035NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240131_203712__28900.04.194280[0, 312]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203712__289.json25.0missing{\n "num_gpu": 99\n}missing
1036NVIDIA-RTX-4090-4xaudi_filtercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203715__60300.03.826930[0, 285]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203715__603.json50.0missing{\n "num_gpu": 99\n}missing
1037Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonAsIs1SHOTfalsefalse520231213_232706__24800.010.38530[95, 303]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__AsIs__1SHOT__20231213_232706__248.json0.0missingmissingmissing
1038Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonAsIs1SHOTfalsefalse520231224_230424__80700.060.72450[91, 1069]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__AsIs__1SHOT__20231224_230424__807.json0.0missing{\n "num_gpu": 99\n}missing
1039Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonAsIs1SHOTfalsefalse520231224_230510__22200.045.6850[91, 818]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__AsIs__1SHOT__20231224_230510__222.json0.0missing{\n "num_gpu": 99\n}missing
1040Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonInJulia1SHOTfalsefalse520231213_232656__69100.012.95910[112, 373]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__InJulia__1SHOT__20231213_232656__691.json0.0missingmissingmissing
1041Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonInJulia1SHOTfalsefalse520231224_230310__98700.019.97440[94, 362]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_230310__987.json0.0missing{\n "num_gpu": 99\n}missing
1042Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonInJulia1SHOTfalsefalse520231224_230323__34600.013.74820[94, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__InJulia__1SHOT__20231224_230323__346.json0.0missing{\n "num_gpu": 99\n}missing
1043Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231213_232643__16300.05.086130[141, 128]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231213_232643__163.json0.0missingmissingmissing
1044Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231224_230243__75200.029.38510[95, 533]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_230243__752.json0.0missing{\n "num_gpu": 99\n}missing
1045Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231224_230250__29700.06.6510[95, 112]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231224_230250__297.json0.0missing{\n "num_gpu": 99\n}missing
1046Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231213_232638__83500.024.35320[311, 598]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232638__835.json0.0missingmissingmissing
1047Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231224_230212__24200.015.00380[204, 58]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230212__242.json0.0missing{\n "num_gpu": 99\n}missing
1048Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231213_232753__16500.020.47150[11, 546]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232753__165.json25.0missingmissingmissing
1049Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231224_230551__63800.08.09790[112, 135]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230551__638.json0.0missing{\n "num_gpu": 99\n}missing
1050Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231224_230553__16800.02.292630[112, 24]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230553__168.json0.0missing{\n "num_gpu": 99\n}missing
1051Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231213_232732__71800.026.28380[412, 600]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231213_232732__718.json50.0missingmissingmissing
1052Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231224_230535__47300.024.90750[109, 447]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_230535__473.json0.0missing{\n "num_gpu": 99\n}missing
1053Apple-MacBook-Pro-M1audi_filtercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231224_230543__85000.08.027350[109, 134]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231224_230543__850.json0.0missing{\n "num_gpu": 99\n}missing
1054NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_204358__50100.07.302220[0, 266]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_204358__501.json0.0missing{\n "num_gpu": 99\n}missing
1055NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_204402__49500.04.191230[0, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_204402__495.json0.0missing{\n "num_gpu": 99\n}missing
1056NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_204408__15000.05.125870[0, 187]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_204408__150.json0.0missing{\n "num_gpu": 99\n}missing
1057NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_204417__95600.09.126290[0, 332]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_204417__956.json0.0missing{\n "num_gpu": 99\n}missing
1058NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_204426__20500.08.973980[0, 326]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_204426__205.json0.0missing{\n "num_gpu": 99\n}missing
1059NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_204252__42800.08.83380[0, 321]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_204252__428.json50.0missing{\n "num_gpu": 99\n}missing
1060NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_204258__73500.05.631890[0, 205]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_204258__735.json50.0missing{\n "num_gpu": 99\n}missing
1061NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_204304__98400.06.127120[0, 223]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_204304__984.json0.0missing{\n "num_gpu": 99\n}missing
1062NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_204307__55800.02.137360[0, 78]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_204307__558.json0.0missing{\n "num_gpu": 99\n}missing
1063NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_204313__62400.05.802260[0, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_204313__624.json0.0missing{\n "num_gpu": 99\n}missing
1064NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_204128__97100.07.708420[0, 278]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_204128__971.json50.0missing{\n "num_gpu": 99\n}missing
1065NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_204138__38800.09.726450[0, 350]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_204138__388.json50.0missing{\n "num_gpu": 99\n}missing
1066NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_204142__95500.03.810620[0, 138]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_204142__955.json0.0missing{\n "num_gpu": 99\n}missing
1067NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_204159__99500.017.22230[0, 617]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_204159__995.json25.0missing{\n "num_gpu": 99\n}missing
1068NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_204205__74200.05.110240[0, 185]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_204205__742.json0.0missing{\n "num_gpu": 99\n}missing
1069NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240131_204619__66100.04.077810[0, 147]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204619__661.json25.0missing{\n "num_gpu": 99\n}missing
1070NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_204626__97900.07.315840[0, 263]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204626__979.json0.0missing{\n "num_gpu": 99\n}missing
1071NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_204643__60300.017.54150[0, 627]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204643__603.json50.0missing{\n "num_gpu": 99\n}missing
1072NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240131_204705__56400.021.18730[0, 757]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204705__564.json25.0missing{\n "num_gpu": 99\n}missing
1073NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240131_204722__10500.016.67360[0, 596]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204722__105.json25.0missing{\n "num_gpu": 99\n}missing
1074NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_204456__38600.00.1412190[0, 5]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_204456__386.json0.0missing{\n "num_gpu": 99\n}missing
1075NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_204517__44600.021.54790[0, 769]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_204517__446.json50.0missing{\n "num_gpu": 99\n}missing
1076NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_204527__86300.09.717980[0, 348]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_204527__863.json0.0missing{\n "num_gpu": 99\n}missing
1077NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240131_204533__74900.06.127060[0, 220]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_204533__749.json25.0missing{\n "num_gpu": 99\n}missing
1078NVIDIA-RTX-4090-4xaudi_filtercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_204543__35000.09.31960[0, 334]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_204543__350.json0.0missing{\n "num_gpu": 99\n}missing
1079NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_202640__22300.012.49870[0, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_202640__223.json50.0missing{\n "num_gpu": 99\n}missing
1080NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_202653__75200.012.67940[0, 314]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_202653__752.json0.0missing{\n "num_gpu": 99\n}missing
1081NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_202701__96100.08.174631[0, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_202701__961.json62.5missing{\n "num_gpu": 99\n}missing
1082NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_203206__23300.04.272080[126, 98]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_203206__233.json0.0missing{\n "num_gpu": 99\n}missing
1083NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_070321__19440.055.33962[127, 705]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_070321__194.json95.0missing{\n "num_gpu": 99\n}missing
1084NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_202524__71900.05.633190[0, 140]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_202524__719.json0.0missing{\n "num_gpu": 99\n}missing
1085NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_202525__33600.00.8042830[0, 20]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_202525__336.json0.0missing{\n "num_gpu": 99\n}missing
1086NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_202527__95000.02.449520[0, 61]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_202527__950.json0.0missing{\n "num_gpu": 99\n}missing
1087NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_202535__92800.08.426150[0, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_202535__928.json0.0missing{\n "num_gpu": 99\n}missing
1088NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_202544__34100.08.716440[0, 216]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_202544__341.json0.0missing{\n "num_gpu": 99\n}missing
1089NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_202405__11900.07.461970[0, 184]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_202405__119.json0.0missing{\n "num_gpu": 99\n}missing
1090NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_202412__29700.07.419380[0, 183]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_202412__297.json0.0missing{\n "num_gpu": 99\n}missing
1091NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_202419__70500.07.164460[0, 177]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_202419__705.json0.0missing{\n "num_gpu": 99\n}missing
1092NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_202428__97600.08.973560[0, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_202428__976.json0.0missing{\n "num_gpu": 99\n}missing
1093NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruefalse520240131_202438__36100.09.756780[0, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_202438__361.json25.0missing{\n "num_gpu": 99\n}missing
1094NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_203449__87900.08.046860[0, 197]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203449__879.json0.0missing{\n "num_gpu": 99\n}missing
1095NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_203458__16600.08.864820[0, 217]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203458__166.json0.0missing{\n "num_gpu": 99\n}missing
1096NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_203505__71100.07.019380[0, 172]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203505__711.json0.0missing{\n "num_gpu": 99\n}missing
1097NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_203510__18800.04.841340[0, 119]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203510__188.json0.0missing{\n "num_gpu": 99\n}missing
1098NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_203513__54300.02.961910[0, 73]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203513__543.json0.0missing{\n "num_gpu": 99\n}missing
1099NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_203328__42600.020.32780[0, 495]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_203328__426.json50.0missing{\n "num_gpu": 99\n}missing
1100NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_203340__89100.010.85140[0, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_203340__891.json50.0missing{\n "num_gpu": 99\n}missing
1101NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_203349__37910.09.321522[0, 228]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_203349__379.json80.0missing{\n "num_gpu": 99\n}missing
1102NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240131_203349__94800.00.1273080[0, 3]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_203349__948.json0.0missing{\n "num_gpu": 99\n}missing
1103NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240131_203350__86300.00.1249460[0, 3]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_203350__863.json0.0missing{\n "num_gpu": 99\n}missing
1104NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_201732__54900.011.62750[0, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_201732__549.json50.0missing{\n "num_gpu": 99\n}missing
1105NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_201745__81100.013.07710[0, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_201745__811.json0.0missing{\n "num_gpu": 99\n}missing
1106NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_201756__85400.011.68090[0, 220]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_201756__854.json0.0missing{\n "num_gpu": 99\n}missing
1107NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_201808__90800.011.20560[0, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_201808__908.json0.0missing{\n "num_gpu": 99\n}missing
1108NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_201822__38500.014.18560[0, 267]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_201822__385.json0.0missing{\n "num_gpu": 99\n}missing
1109NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_201503__29700.024.48390[0, 458]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_201503__297.json0.0missing{\n "num_gpu": 99\n}missing
1110NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_201518__88200.015.83150[0, 297]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_201518__882.json0.0missing{\n "num_gpu": 99\n}missing
1111NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_201538__59600.019.36780[0, 363]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_201538__596.json0.0missing{\n "num_gpu": 99\n}missing
1112NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_201552__81800.014.40190[0, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_201552__818.json0.0missing{\n "num_gpu": 99\n}missing
1113NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_201612__88000.019.53531[0, 366]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_201612__880.json62.5missing{\n "num_gpu": 99\n}missing
1114NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_201249__28400.023.51510[0, 437]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_201249__284.json0.0missing{\n "num_gpu": 99\n}missing
1115NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_201306__79800.016.48380[0, 307]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_201306__798.json0.0missing{\n "num_gpu": 99\n}missing
1116NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_201313__54100.07.221520[0, 135]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_201313__541.json0.0missing{\n "num_gpu": 99\n}missing
1117NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_201329__77200.015.88170[0, 296]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_201329__772.json0.0missing{\n "num_gpu": 99\n}missing
1118NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_201341__19300.011.83910[0, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_201341__193.json50.0missing{\n "num_gpu": 99\n}missing
1119NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_202156__40600.019.21280[0, 356]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_202156__406.json0.0missing{\n "num_gpu": 99\n}missing
1120NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_202206__47800.09.472740[0, 176]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_202206__478.json0.0missing{\n "num_gpu": 99\n}missing
1121NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_202215__94900.09.033660[0, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_202215__949.json0.0missing{\n "num_gpu": 99\n}missing
1122NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_202236__10650.020.88522[0, 387]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_202236__106.json100.0missing{\n "num_gpu": 99\n}missing
1123NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_202246__88000.09.756020[0, 181]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_202246__880.json0.0missing{\n "num_gpu": 99\n}missing
1124NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_201925__83000.013.83550[0, 257]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_201925__830.json50.0missing{\n "num_gpu": 99\n}missing
1125NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_201934__49600.08.603180[0, 160]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_201934__496.json0.0missing{\n "num_gpu": 99\n}missing
1126NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_201945__87600.011.29390[0, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_201945__876.json0.0missing{\n "num_gpu": 99\n}missing
1127NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_202009__80100.023.86530[0, 442]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_202009__801.json0.0missing{\n "num_gpu": 99\n}missing
1128NVIDIA-RTX-4090-4xaudi_filtercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_202028__58700.018.57230[0, 344]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_202028__587.json0.0missing{\n "num_gpu": 99\n}missing
1129NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203849__75900.02.644450[0, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203849__759.json50.0missing{\n "num_gpu": 99\n}missing
1130NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203853__44500.03.829870[0, 464]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203853__445.json50.0missing{\n "num_gpu": 99\n}missing
1131NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203856__97200.03.214980[0, 391]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203856__972.json50.0missing{\n "num_gpu": 99\n}missing
1132NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203858__14140.02.18082[0, 266]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203858__141.json95.0missing{\n "num_gpu": 99\n}missing
1133NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_203900__64450.01.325222[0, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_203900__644.json100.0missing{\n "num_gpu": 99\n}missing
1134NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_203827__18500.01.688610[0, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203827__185.json50.0missing{\n "num_gpu": 99\n}missing
1135NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_203828__33200.00.8102350[0, 99]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203828__332.json0.0missing{\n "num_gpu": 99\n}missing
1136NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_203829__49100.01.705360[0, 208]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203829__491.json50.0missing{\n "num_gpu": 99\n}missing
1137NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_203831__62200.01.939350[0, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203831__622.json0.0missing{\n "num_gpu": 99\n}missing
1138NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_203833__64800.01.435640[0, 175]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_203833__648.json50.0missing{\n "num_gpu": 99\n}missing
1139NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203807__27300.01.879160[0, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203807__273.json0.0missing{\n "num_gpu": 99\n}missing
1140NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203808__49300.01.208110[0, 146]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203808__493.json0.0missing{\n "num_gpu": 99\n}missing
1141NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203811__36700.02.568070[0, 308]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203811__367.json0.0missing{\n "num_gpu": 99\n}missing
1142NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203813__55200.02.883930[0, 345]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203813__552.json0.0missing{\n "num_gpu": 99\n}missing
1143NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_203815__33100.01.052140[0, 127]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_203815__331.json0.0missing{\n "num_gpu": 99\n}missing
1144NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_203955__24800.03.358050[0, 397]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_203955__248.json50.0missing{\n "num_gpu": 99\n}missing
1145NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_204000__55150.04.805212[0, 565]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204000__551.json100.0missing{\n "num_gpu": 99\n}missing
1146NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_204004__28400.03.120110[0, 369]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204004__284.json50.0missing{\n "num_gpu": 99\n}missing
1147NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240131_204006__31600.02.470060[0, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204006__316.json25.0missing{\n "num_gpu": 99\n}missing
1148NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_204010__75300.03.125250[0, 370]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_204010__753.json50.0missing{\n "num_gpu": 99\n}missing
1149NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203922__80000.03.250561[0, 383]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203922__800.json62.5missing{\n "num_gpu": 99\n}missing
1150NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203926__33500.03.765530[0, 444]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203926__335.json50.0missing{\n "num_gpu": 99\n}missing
1151NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203929__19100.03.171650[0, 375]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203929__191.json50.0missing{\n "num_gpu": 99\n}missing
1152NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_203933__47200.03.47970[0, 408]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203933__472.json50.0missing{\n "num_gpu": 99\n}missing
1153NVIDIA-RTX-4090-4xaudi_filtercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_203936__48800.02.548920[0, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_203936__488.json0.0missing{\n "num_gpu": 99\n}missing
1154Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_212234__80600.018.28530[95, 530]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_212234__806.json0.0missingmissingmissing
1155Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_212245__70300.010.78950[1, 335]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_212245__703.json0.0missingmissingmissing
1156Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_212256__40900.010.8360[1, 336]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_212256__409.json0.0missingmissingmissing
1157Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231224_232851__71800.045.23770[115, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_232851__718.json0.0missing{\n "num_gpu": 99\n}missing
1158Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231224_232934__52100.042.21240[115, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_232934__521.json0.0missing{\n "num_gpu": 99\n}missing
1159Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_212201__36800.020.40520[1, 604]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_212201__368.json0.0missingmissingmissing
1160Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_212216__68700.014.38850[1, 438]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_212216__687.json0.0missingmissingmissing
1161Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231224_232702__97750.040.82842[118, 232]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_232702__977.json100.0missing{\n "num_gpu": 99\n}missing
1162Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231224_232806__26100.063.78850[118, 379]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_232806__261.json25.0missing{\n "num_gpu": 99\n}missing
1163Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231226_213533__40000.045.21630[118, 266]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_213533__400.json25.0missing{\n "num_gpu": 99\n}missing
1164Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_212117__97000.08.902310[1, 275]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212117__970.json0.0missingmissingmissing
1165Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_212119__14300.02.480830[1, 79]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212119__143.json50.0missingmissingmissing
1166Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231224_232544__25200.052.44880[159, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_232544__252.json0.0missing{\n "num_gpu": 99\n}missing
1167Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_232620__19020.035.35752[159, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_232620__190.json85.0missing{\n "num_gpu": 99\n}missing
1168Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_213448__25100.054.43960[159, 317]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_213448__251.json0.0missing{\n "num_gpu": 99\n}missing
1169Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_212039__93200.020.66870[1, 574]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212039__932.json0.0missingmissingmissing
1170Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_212054__36100.015.53670[1, 441]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212054__361.json50.0missingmissingmissing
1171Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231224_232411__59050.078.50922[334, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_232411__590.json100.0missing{\n "num_gpu": 99\n}missing
1172Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231224_232452__73200.039.46020[334, 187]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_232452__732.json25.0missing{\n "num_gpu": 99\n}missing
1173Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_213353__82620.080.96412[334, 297]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_213353__826.json85.0missing{\n "num_gpu": 99\n}missing
1174Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_212458__60500.016.27980[1, 448]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_212458__605.json25.0missingmissingmissing
1175Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_212518__44800.020.59760[1, 557]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_212518__448.json50.0missingmissingmissing
1176Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_233230__52300.045.68350[447, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233230__523.json50.0missing{\n "num_gpu": 99\n}missing
1177Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_233257__27600.026.06780[447, 92]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233257__276.json50.0missing{\n "num_gpu": 99\n}missing
1178Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_213758__26400.055.15890[447, 269]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_213758__264.json50.0missing{\n "num_gpu": 99\n}missing
1179Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_212353__42400.036.28720[1, 929]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212353__424.json0.0missingmissingmissing
1180Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_212419__97700.026.38180[1, 699]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212419__977.json25.0missingmissingmissing
1181Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_233040__88500.066.70250[445, 335]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233040__885.json50.0missing{\n "num_gpu": 99\n}missing
1182Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231224_233145__95800.063.18670[445, 312]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233145__958.json25.0missing{\n "num_gpu": 99\n}missing
1183Apple-MacBook-Pro-M1audi_filterdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_213702__16300.089.1870[445, 471]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_213702__163.json50.0missing{\n "num_gpu": 99\n}missing
1184Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231226_215357__32200.07.711960[118, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_215357__322.json0.0missing{\n "num_gpu": 99\n}missing
1185Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_101255__83300.07.572540[118, 286]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_101255__833.json0.0missing{\n "num_gpu": 99\n}missing
1186Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_101303__49400.08.003990[118, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_101303__494.json0.0missing{\n "num_gpu": 99\n}missing
1187Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_101318__50900.014.75640[118, 553]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_101318__509.json0.0missing{\n "num_gpu": 99\n}missing
1188Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_215349__38500.07.693350[155, 284]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_215349__385.json0.0missing{\n "num_gpu": 99\n}missing
1189Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_101235__87600.08.442830[155, 313]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_101235__876.json50.0missing{\n "num_gpu": 99\n}missing
1190Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_101240__23800.05.32090[155, 193]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_101240__238.json50.0missing{\n "num_gpu": 99\n}missing
1191Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_101248__79700.07.09560[155, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_101248__797.json0.0missing{\n "num_gpu": 99\n}missing
1192Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_215341__51100.09.860170[324, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215341__511.json0.0missing{\n "num_gpu": 99\n}missing
1193Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_101216__70700.08.359440[324, 154]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101216__707.json25.0missing{\n "num_gpu": 99\n}missing
1194Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_101223__17100.07.458480[324, 243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101223__171.json0.0missing{\n "num_gpu": 99\n}missing
1195Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_101226__57300.03.398980[324, 90]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101226__573.json50.0missing{\n "num_gpu": 99\n}missing
1196Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_215416__96500.03.45850[407, 80]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215416__965.json0.0missing{\n "num_gpu": 99\n}missing
1197Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_101342__65600.010.3420[407, 332]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101342__656.json0.0missing{\n "num_gpu": 99\n}missing
1198Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_101350__34900.08.58850[407, 269]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101350__349.json0.0missing{\n "num_gpu": 99\n}missing
1199Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_101401__99100.010.1890[407, 327]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_101401__991.json0.0missing{\n "num_gpu": 99\n}missing
1200Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231226_215412__50300.015.35860[404, 508]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_215412__503.json0.0missing{\n "num_gpu": 99\n}missing
1201Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_101322__82300.03.803510[404, 93]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_101322__823.json0.0missing{\n "num_gpu": 99\n}missing
1202Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_101327__30400.05.191290[404, 145]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_101327__304.json0.0missing{\n "num_gpu": 99\n}missing
1203Apple-MacBook-Pro-M1audi_filterdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse520231227_101331__95100.04.440210[404, 117]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_101331__951.json25.0missing{\n "num_gpu": 99\n}missing
1204Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_104429__27300.04.909610[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104429__273.json50.0missingmissingmissing
1205Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_104432__63900.02.729520[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104432__639.json50.0missingmissingmissing
1206Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_104435__24300.03.034910[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104435__243.json25.0missingmissingmissing
1207Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_104442__82800.06.603480[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104442__828.json0.0missingmissingmissing
1208Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_104445__36600.03.450960[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104445__366.json50.0missingmissingmissing
1209Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104346__94800.02.605970[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104346__948.json50.0missingmissingmissing
1210Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104349__96300.02.651570[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104349__963.json50.0missingmissingmissing
1211Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_104352__69200.02.463310[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104352__692.json0.0missingmissingmissing
1212Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104358__18700.06.149770[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104358__187.json50.0missingmissingmissing
1213Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104400__73500.02.279730[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104400__735.json50.0missingmissingmissing
1214Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_104313__18500.02.763860[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104313__185.json25.0missingmissingmissing
1215Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_104315__95600.02.645350[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104315__956.json0.0missingmissingmissing
1216Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_104318__35000.03.061150[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104318__350.json50.0missingmissingmissing
1217Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_104323__60000.04.860[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104323__600.json25.0missingmissingmissing
1218Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_104327__34900.03.4120[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104327__349.json50.0missingmissingmissing
1219Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_104601__70600.011.80620[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104601__706.json25.0missingmissingmissing
1220Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_104607__29400.05.567830[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104607__294.json25.0missingmissingmissing
1221Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_104612__56900.05.240330[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104612__569.json50.0missingmissingmissing
1222Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_104616__66200.03.788060[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104616__662.json25.0missingmissingmissing
1223Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_104619__28200.02.360440[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104619__282.json25.0missingmissingmissing
1224Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_104514__50700.03.384270[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104514__507.json50.0missingmissingmissing
1225Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_104517__86100.03.585720[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104517__861.json50.0missingmissingmissing
1226Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_104520__86800.02.899660[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104520__868.json0.0missingmissingmissing
1227Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_104523__41000.02.774420[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104523__410.json50.0missingmissingmissing
1228Apple-MacBook-Pro-M1audi_filtergemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_104528__59800.04.944040[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104528__598.json0.0missingmissingmissing
1229Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_213714__30800.09.586480[0, 149]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_213714__308.json0.0missingmissingmissing
1230Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_213734__44300.020.50790[0, 320]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_213734__443.json25.0missingmissingmissing
1231Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_213741__12300.06.790210[0, 106]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_213741__123.json25.0missingmissingmissing
1232Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_213747__79800.05.559680[0, 85]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_213747__798.json25.0missingmissingmissing
1233Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_213756__56100.09.496980[0, 149]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_213756__561.json0.0missingmissingmissing
1234Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_213554__53200.06.262030[0, 98]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_213554__532.json0.0missingmissingmissing
1235Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_213559__10900.05.008680[0, 78]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_213559__109.json25.0missingmissingmissing
1236Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_213606__31500.06.331430[0, 97]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_213606__315.json0.0missingmissingmissing
1237Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_213610__23800.04.185760[0, 65]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_213610__238.json50.0missingmissingmissing
1238Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_213616__30400.05.601730[0, 88]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_213616__304.json25.0missingmissingmissing
1239Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_213323__52100.024.68540[0, 383]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_213323__521.json25.0missingmissingmissing
1240Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_213353__32300.029.85710[0, 461]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_213353__323.json25.0missingmissingmissing
1241Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_213419__80200.026.42140[0, 409]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_213419__802.json25.0missingmissingmissing
1242Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_213447__14200.027.72960[0, 425]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_213447__142.json25.0missingmissingmissing
1243Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_213518__23500.030.61040[0, 472]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_213518__235.json25.0missingmissingmissing
1244Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_214417__56900.029.55680[0, 453]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_214417__569.json50.0missingmissingmissing
1245Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_214439__44100.022.35630[0, 344]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_214439__441.json50.0missingmissingmissing
1246Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_214503__48300.023.82480[0, 367]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_214503__483.json50.0missingmissingmissing
1247Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse520240223_214526__17300.022.32710[0, 344]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_214526__173.json25.0missingmissingmissing
1248Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_214547__46200.020.9870[0, 320]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_214547__462.json50.0missingmissingmissing
1249Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_214022__88400.025.3530[0, 392]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_214022__884.json50.0missingmissingmissing
1250Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_214042__69100.019.99830[0, 307]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_214042__691.json50.0missingmissingmissing
1251Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_214103__45400.021.28270[0, 327]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_214103__454.json50.0missingmissingmissing
1252Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_214125__31500.021.67350[0, 334]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_214125__315.json50.0missingmissingmissing
1253Apple-MacBook-Pro-M1audi_filtergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_214146__50800.021.21830[0, 327]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_214146__508.json50.0missingmissingmissing
1254Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboAsIs1SHOTfalsefalse520231213_212104__60700.0002673.081390[99, 145]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_212104__607.json0.0missingmissingmissing
1255Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboAsIs1SHOTfalsefalse520231225_182943__42600.00027453.022070[99, 150]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_182943__426.json0.0missingmissingmissing
1256Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboAsIs1SHOTfalsefalse520231225_182947__19100.0002733.326920[99, 149]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_182947__191.json0.0missingmissingmissing
1257Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_185744__84300.04.039470[99, 188]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_185744__843.json0.00.5missing0.5
1258Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboInJulia1SHOTtruetrue520231213_212101__35100.0004145.305730[102, 242]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_212101__351.json50.0missingmissingmissing
1259Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboInJulia1SHOTtruetrue520231225_182933__13600.00033153.776520[102, 187]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_182933__136.json50.0missingmissingmissing
1260Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboInJulia1SHOTtruetrue520231225_182940__51800.0003576.931820[102, 204]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_182940__518.json50.0missingmissingmissing
1261Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboInJulia1SHOTtruetrue520231227_190153__81300.0004115.135030[102, 240]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_190153__813.json50.0missingmissingmissing
1262Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboInJulia1SHOTtruetrue520231227_190200__93900.0004146.645880[102, 242]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_190200__939.json50.0missingmissingmissing
1263Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_185740__78600.04.055260[102, 181]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_185740__786.json50.00.5missing0.5
1264Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_212055__54100.00027410.95180[137, 137]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_212055__541.json50.0missingmissingmissing
1265Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_182924__57400.0002052.315730[137, 91]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_182924__574.json50.0missingmissingmissing
1266Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_182928__85200.00031153.500170[137, 162]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_182928__852.json50.0missingmissingmissing
1267Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertAsk1SHOTfalsefalse520231227_190146__49000.0002532.592460[137, 123]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_190146__490.json0.0missingmissingmissing
1268Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_190147__61600.0001811.552250[137, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_190147__616.json50.0missingmissingmissing
1269Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_185735__63800.01.712290[137, 72]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_185735__638.json50.00.5missing0.5
1270Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_212044__87300.0002543.131630[283, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212044__873.json0.0missingmissingmissing
1271Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_182916__62200.00026753.203030[283, 84]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182916__622.json0.0missingmissingmissing
1272Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertCoTTask1SHOTtruefalse520231225_182921__39400.00056755.412520[283, 284]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_182921__394.json25.0missingmissingmissing
1273Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_190141__36000.00029752.424730[283, 104]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190141__360.json0.0missingmissingmissing
1274Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_190143__83600.00024951.877760[283, 72]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190143__836.json0.0missingmissingmissing
1275Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_185733__49700.02.33060[283, 90]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_185733__497.json0.00.5missing0.5
1276Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231213_212109__97500.00028952.081660[360, 73]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212109__975.json0.0missingmissingmissing
1277Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_182957__69800.00024751.055650[360, 45]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182957__698.json0.0missingmissingmissing
1278Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_182959__36500.00034051.934410[360, 107]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_182959__365.json0.0missingmissingmissing
1279Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_190211__25000.00029551.803060[360, 77]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190211__250.json0.0missingmissingmissing
1280Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_190216__73000.0005434.414670[360, 242]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190216__730.json50.0missingmissingmissing
1281Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue520231215_185753__90700.06.220440[360, 276]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_185753__907.json50.00.5missing0.5
1282Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_212106__71800.0002982.570630[359, 79]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_212106__718.json0.0missingmissingmissing
1283Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_182948__74800.00027551.325410[359, 64]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_182948__748.json0.0missingmissingmissing
1284Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231225_182955__61600.0008537.16710[359, 449]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_182955__616.json50.0missingmissingmissing
1285Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231227_190203__11900.00035952.201930[359, 120]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_190203__119.json50.0missingmissingmissing
1286Apple-MacBook-Pro-M1audi_filtergpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231227_190209__18800.00063256.208110[359, 302]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_190209__188.json50.0missingmissingmissing
1287Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_185746__14500.02.208110[359, 86]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_185746__145.json0.00.5missing0.5
1288Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_212124__12500.0006737.056950[99, 287]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_212124__125.json0.0missingmissingmissing
1289Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_183017__17900.0003392.282130[99, 120]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_183017__179.json0.0missingmissingmissing
1290Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_183020__38200.0005153.179020[99, 208]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_183020__382.json0.0missingmissingmissing
1291Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_185806__45500.02.774650[99, 120]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_185806__455.json0.00.9missing0.1
1292Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_212117__25400.0003582.348210[102, 128]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_212117__254.json50.0missingmissingmissing
1293Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_183012__44200.0004963.103971[102, 197]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_183012__442.json62.5missingmissingmissing
1294Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_183014__21800.0003682.136940[102, 133]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_183014__218.json50.0missingmissingmissing
1295Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_190231__23550.0004162.570362[102, 157]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_190231__235.json100.0missingmissingmissing
1296Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_190233__67400.000352.132720[102, 124]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_190233__674.json50.0missingmissingmissing
1297Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_185803__12500.04.380670[102, 151]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_185803__125.json50.00.9missing0.1
1298Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_212114__92150.0002871.519312[137, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_212114__921.json100.0missingmissingmissing
1299Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_183007__89200.0002892.125310[137, 76]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_183007__892.json50.0missingmissingmissing
1300Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_183009__31000.0003111.598891[137, 87]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_183009__310.json62.5missingmissingmissing
1301Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_190226__24350.0003131.767992[137, 88]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_190226__243.json100.0missingmissingmissing
1302Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_190228__88250.0002831.787942[137, 73]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_190228__882.json100.0missingmissingmissing
1303Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_185758__69000.01.650970[137, 73]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_185758__690.json50.00.9missing0.1
1304Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231213_212112__54400.0006133.450570[283, 165]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212112__544.json25.0missingmissingmissing
1305Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231225_183002__34800.0006092.86480[283, 163]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183002__348.json25.0missingmissingmissing
1306Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_183004__98500.0004191.779160[283, 68]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183004__985.json50.0missingmissingmissing
1307Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_190220__62850.0006113.721882[283, 164]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190220__628.json100.0missingmissingmissing
1308Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_190224__90000.0006093.430860[283, 163]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190224__900.json25.0missingmissingmissing
1309Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruefalse520231215_185756__20000.03.151960[283, 163]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_185756__200.json25.00.9missing0.1
1310Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231213_212131__27150.0007844.045492[360, 212]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212131__271.json100.0missingmissingmissing
1311Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_183028__28500.0005221.817560[360, 81]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183028__285.json0.0missingmissingmissing
1312Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_183029__18100.0005141.523010[360, 77]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183029__181.json0.0missingmissingmissing
1313Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_190240__72900.0005281.643210[360, 84]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190240__729.json0.0missingmissingmissing
1314Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_190242__52600.0005442.122490[360, 92]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190242__526.json0.0missingmissingmissing
1315Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_185812__19700.03.816480[360, 163]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_185812__197.json0.00.9missing0.1
1316Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_212126__29750.0005491.784642[359, 95]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_212126__297.json100.0missingmissingmissing
1317Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_183022__51700.0005672.099740[359, 104]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_183022__517.json50.0missingmissingmissing
1318Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_183025__74250.0006272.361592[359, 134]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_183025__742.json100.0missingmissingmissing
1319Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_190236__55200.0005992.706330[359, 120]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_190236__552.json50.0missingmissingmissing
1320Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_190238__69950.0005091.565322[359, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_190238__699.json100.0missingmissingmissing
1321Apple-MacBook-Pro-M1audi_filtergpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_185808__54600.02.363021[359, 87]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_185808__546.json62.50.9missing0.1
1322Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewAsIs1SHOTfalsefalse520231213_212258__24600.0093323.56670[99, 278]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_212258__246.json0.0missingmissingmissing
1323Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewAsIs1SHOTfalsefalse520231225_183225__16400.0104715.23440[99, 316]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_183225__164.json0.0missingmissingmissing
1324Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewAsIs1SHOTfalsefalse520231225_183244__92200.009319.05370[99, 277]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_183244__922.json0.0missingmissingmissing
1325Apple-MacBook-Pro-M1audi_filtergpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_185956__22100.026.46450[99, 276]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_185956__221.json0.00.1missing0.9
1326Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewInJulia1SHOTtruetrue520231213_212235__90200.010223.26440[102, 306]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_212235__902.json50.0missingmissingmissing
1327Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewInJulia1SHOTtruetrue520231225_183141__44800.0099310.92620[102, 297]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_183141__448.json50.0missingmissingmissing
1328Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewInJulia1SHOTtruetrue520231225_183209__11600.0158428.03330[102, 494]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_183209__116.json50.0missingmissingmissing
1329Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewInJulia1SHOTtruetrue520231227_190428__73100.0129927.86190[102, 399]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_190428__731.json50.0missingmissingmissing
1330Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewInJulia1SHOTtruetrue520231227_190455__82300.0107126.43080[102, 323]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_190455__823.json50.0missingmissingmissing
1331Apple-MacBook-Pro-M1audi_filtergpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_185929__70000.022.06770[102, 299]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_185929__700.json50.00.1missing0.9
1332Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_212211__32100.0073715.73280[137, 200]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_212211__321.json50.0missingmissingmissing
1333Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_183120__20950.0060210.25822[137, 155]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_183120__209.json100.0missingmissingmissing
1334Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_183129__28400.007529.193010[137, 205]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_183129__284.json50.0missingmissingmissing
1335Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_190343__37750.0062910.78852[137, 164]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_190343__377.json100.0missingmissingmissing
1336Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_190400__83100.0091716.75270[137, 260]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_190400__831.json50.0missingmissingmissing
1337Apple-MacBook-Pro-M1audi_filtergpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_185907__21700.013.55370[137, 195]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_185907__217.json50.00.1missing0.9
1338Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_212155__92750.0142924.1392[283, 382]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212155__927.json100.0missingmissingmissing
1339Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231225_183053__62300.0151924.06060[283, 412]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183053__623.json25.0missingmissingmissing
1340Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_183109__38000.0125515.22460[283, 324]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183109__380.json50.0missingmissingmissing
1341Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_190302__27150.0130319.97192[283, 340]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190302__271.json100.0missingmissingmissing
1342Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231227_190332__40100.015129.21270[283, 409]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190332__401.json25.0missingmissingmissing
1343Apple-MacBook-Pro-M1audi_filtergpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruefalse520231215_185853__54800.040.43820[283, 347]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_185853__548.json25.00.1missing0.9
1344Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_212349__89000.0130520.98550[360, 315]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212349__890.json50.0missingmissingmissing
1345Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_183407__43950.0147322.88982[360, 371]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183407__439.json100.0missingmissingmissing
1346Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_183427__88700.0150919.73070[360, 383]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183427__887.json50.0missingmissingmissing
1347Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_190636__88500.0130220.790[360, 314]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190636__885.json50.0missingmissingmissing
1348Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_190654__44400.0121217.73710[360, 284]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190654__444.json50.0missingmissingmissing
1349Apple-MacBook-Pro-M1audi_filtergpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190056__85200.027.92920[360, 379]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190056__852.json50.00.1missing0.9
1350Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_212327__38500.0143629.13920[359, 359]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_212327__385.json50.0missingmissingmissing
1351Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_183330__44800.0204845.91560[359, 563]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_183330__448.json50.0missingmissingmissing
1352Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_183343__79400.0133412.76910[359, 325]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_183343__794.json50.0missingmissingmissing
1353Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_190541__44000.0167345.62520[359, 438]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_190541__440.json50.0missingmissingmissing
1354Apple-MacBook-Pro-M1audi_filtergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_190615__78700.0211733.31920[359, 586]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_190615__787.json50.0missingmissingmissing
1355Apple-MacBook-Pro-M1audi_filtergpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_190028__48500.031.50220[359, 374]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_190028__485.json50.00.1missing0.9
1356Apple-MacBook-Pro-M1audi_filterllama2AsIs1SHOTfalsefalse520231213_231817__26800.017.56280[95, 508]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__AsIs__1SHOT__20231213_231817__268.json0.0missingmissingmissing
1357Apple-MacBook-Pro-M1audi_filterllama2AsIs1SHOTfalsefalse520231224_224131__80200.019.29170[95, 556]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__AsIs__1SHOT__20231224_224131__802.json0.0missing{\n "num_gpu": 99\n}missing
1358Apple-MacBook-Pro-M1audi_filterllama2AsIs1SHOTfalsefalse520231224_224142__46700.010.96790[1, 339]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__AsIs__1SHOT__20231224_224142__467.json0.0missing{\n "num_gpu": 99\n}missing
1359Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTtruefalse520231213_231800__19900.014.34830[112, 413]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231213_231800__199.json25.0missingmissingmissing
1360Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTfalsefalse520231224_224047__80200.024.83590[112, 698]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231224_224047__802.json0.0missing{\n "num_gpu": 99\n}missing
1361Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTfalsefalse520231224_224112__80900.024.72410[1, 716]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231224_224112__809.json0.0missing{\n "num_gpu": 99\n}missing
1362Apple-MacBook-Pro-M1audi_filterllama2InJulia1SHOTfalsefalse520231226_211603__90100.012.32880[112, 361]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__InJulia__1SHOT__20231226_211603__901.json0.0missing{\n "num_gpu": 99\n}missing
1363Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTfalsefalse520231213_231745__96600.014.06350[141, 393]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231213_231745__966.json0.0missingmissingmissing
1364Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTtruetrue520231224_224015__81800.011.08280[141, 308]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_224015__818.json50.0missing{\n "num_gpu": 99\n}missing
1365Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTtruetrue520231224_224022__53100.06.819890[1, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_224022__531.json50.0missing{\n "num_gpu": 99\n}missing
1366Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertAsk1SHOTfalsefalse520231226_211551__63500.017.12470[141, 486]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_211551__635.json0.0missing{\n "num_gpu": 99\n}missing
1367Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTtruefalse520231213_231731__18500.023.11920[311, 567]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231731__185.json25.0missingmissingmissing
1368Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTfalsefalse520231224_223947__85900.028.06870[329, 545]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_223947__859.json0.0missing{\n "num_gpu": 99\n}missing
1369Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTfalsefalse520231224_224004__55900.017.19740[1, 483]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224004__559.json0.0missing{\n "num_gpu": 99\n}missing
1370Apple-MacBook-Pro-M1audi_filterllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_211534__53300.015.87030[329, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211534__533.json0.0missing{\n "num_gpu": 99\n}missing
1371Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTtruefalse520231213_231858__33100.018.59630[11, 500]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_231858__331.json25.0missingmissingmissing
1372Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTtruetrue520231224_224237__69700.017.32830[11, 468]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224237__697.json50.0missing{\n "num_gpu": 99\n}missing
1373Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTtruetrue520231224_224303__18830.025.71892[1, 680]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224303__188.json90.0missing{\n "num_gpu": 99\n}missing
1374Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapCoTTask1SHOTfalsefalse520231226_211658__60500.021.97960[11, 593]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211658__605.json0.0missing{\n "num_gpu": 99\n}missing
1375Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTfalsefalse520231213_231839__65200.021.4870[412, 480]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231213_231839__652.json0.0missingmissingmissing
1376Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTfalsefalse520231224_224205__63000.022.66240[412, 511]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_224205__630.json0.0missing{\n "num_gpu": 99\n}missing
1377Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTtruefalse520231224_224220__66200.014.90630[1, 412]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_224220__662.json25.0missing{\n "num_gpu": 99\n}missing
1378Apple-MacBook-Pro-M1audi_filterllama2JuliaRecapTask1SHOTfalsefalse520231226_211636__53300.032.20920[412, 754]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_211636__533.json0.0missing{\n "num_gpu": 99\n}missing
1379Apple-MacBook-Pro-M1audi_filtermagicoderAsIs1SHOTfalsefalse520231213_232911__59000.020.38520[95, 585]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__AsIs__1SHOT__20231213_232911__590.json0.0missingmissingmissing
1380Apple-MacBook-Pro-M1audi_filtermagicoderAsIs1SHOTfalsefalse520231224_230700__49200.08.895380[109, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__AsIs__1SHOT__20231224_230700__492.json0.0missing{\n "num_gpu": 99\n}missing
1381Apple-MacBook-Pro-M1audi_filtermagicoderAsIs1SHOTfalsefalse520231224_230707__59800.06.581320[109, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__AsIs__1SHOT__20231224_230707__598.json0.0missing{\n "num_gpu": 99\n}missing
1382Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTfalsefalse520231213_232850__88100.024.67540[112, 694]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231213_232850__881.json0.0missingmissingmissing
1383Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTtruetrue520231224_230642__88600.09.192221[112, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231224_230642__886.json62.5missing{\n "num_gpu": 99\n}missing
1384Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTtruetrue520231224_230651__56000.08.543930[112, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231224_230651__560.json50.0missing{\n "num_gpu": 99\n}missing
1385Apple-MacBook-Pro-M1audi_filtermagicoderInJulia1SHOTtruetrue520231226_212545__13300.06.495870[112, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__InJulia__1SHOT__20231226_212545__133.json50.0missing{\n "num_gpu": 99\n}missing
1386Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTtruetrue520231213_232826__27800.016.87480[141, 471]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231213_232826__278.json50.0missingmissingmissing
1387Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTtruefalse520231224_230627__53100.08.297960[151, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_230627__531.json25.0missing{\n "num_gpu": 99\n}missing
1388Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTfalsefalse520231224_230633__37400.05.774360[151, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231224_230633__374.json0.0missing{\n "num_gpu": 99\n}missing
1389Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertAsk1SHOTtruetrue520231226_212538__23600.09.450830[151, 296]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_212538__236.json50.0missing{\n "num_gpu": 99\n}missing
1390Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231213_232809__84500.015.8180[311, 376]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232809__845.json0.0missingmissingmissing
1391Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTtruefalse520231224_230609__99300.015.83050[321, 275]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230609__993.json25.0missing{\n "num_gpu": 99\n}missing
1392Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231224_230619__29300.09.583970[321, 266]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230619__293.json0.0missing{\n "num_gpu": 99\n}missing
1393Apple-MacBook-Pro-M1audi_filtermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231226_212528__90100.015.71370[321, 278]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212528__901.json0.0missing{\n "num_gpu": 99\n}missing
1394Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruefalse520231213_233007__61600.026.93420[11, 704]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233007__616.json25.0missingmissingmissing
1395Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruetrue520231224_230741__37100.09.640820[415, 254]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230741__371.json50.0missing{\n "num_gpu": 99\n}missing
1396Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruefalse520231224_230752__48400.010.96370[415, 295]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230752__484.json25.0missing{\n "num_gpu": 99\n}missing
1397Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_212604__89000.010.67550[415, 285]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212604__890.json50.0missing{\n "num_gpu": 99\n}missing
1398Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruetrue520231213_232941__63200.029.56010[412, 680]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231213_232941__632.json50.0missingmissingmissing
1399Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruefalse520231224_230719__69900.011.84080[412, 321]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_230719__699.json25.0missing{\n "num_gpu": 99\n}missing
1400Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruetrue520231224_230730__13600.011.63850[412, 318]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231224_230730__136.json50.0missing{\n "num_gpu": 99\n}missing
1401Apple-MacBook-Pro-M1audi_filtermagicoderJuliaRecapTask1SHOTtruetrue520231226_212553__38700.08.284170[412, 212]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_212553__387.json50.0missing{\n "num_gpu": 99\n}missing
1402Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_174702__41600.011.25760[112, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174702__416.json50.0missing{\n "num_gpu": 99\n}missing
1403Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_174714__63500.011.09880[112, 208]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174714__635.json50.0missing{\n "num_gpu": 99\n}missing
1404Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_174727__26400.012.8090[112, 238]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_174727__264.json50.0missing{\n "num_gpu": 99\n}missing
1405Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_174621__73340.011.59452[151, 213]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174621__733.json95.0missing{\n "num_gpu": 99\n}missing
1406Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_174638__97200.016.58950[151, 313]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174638__972.json50.0missing{\n "num_gpu": 99\n}missing
1407Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_174651__31700.012.63411[151, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_174651__317.json62.5missing{\n "num_gpu": 99\n}missing
1408Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_174529__68900.018.53150[321, 325]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174529__689.json0.0missing{\n "num_gpu": 99\n}missing
1409Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_174551__38700.022.30681[321, 396]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174551__387.json62.5missing{\n "num_gpu": 99\n}missing
1410Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_174609__58100.016.81550[321, 292]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174609__581.json0.0missing{\n "num_gpu": 99\n}missing
1411Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_174835__33740.018.20522[415, 308]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174835__337.json95.0missing{\n "num_gpu": 99\n}missing
1412Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_174857__23300.021.42520[415, 353]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174857__233.json25.0missing{\n "num_gpu": 99\n}missing
1413Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_174912__61300.014.65230[415, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_174912__613.json0.0missing{\n "num_gpu": 99\n}missing
1414Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_174748__76200.020.51690[412, 352]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174748__762.json50.0missing{\n "num_gpu": 99\n}missing
1415Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_174758__67200.08.771520[412, 127]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174758__672.json25.0missing{\n "num_gpu": 99\n}missing
1416Apple-MacBook-Pro-M1audi_filtermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_174817__47900.019.43920[412, 333]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_174817__479.json25.0missing{\n "num_gpu": 99\n}missing
1417Apple-MacBook-Pro-M1audi_filtermistral-mediumAsIs1SHOTfalsefalse520231213_212659__57600.0030880421.62820[107, 346]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__AsIs__1SHOT__20231213_212659__576.json0.0missingmissingmissing
1418Apple-MacBook-Pro-M1audi_filtermistral-mediumAsIs1SHOTfalsefalse520231225_183829__81500.002351856.097380[107, 255]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__AsIs__1SHOT__20231225_183829__815.json0.0missingmissingmissing
1419Apple-MacBook-Pro-M1audi_filtermistral-mediumAsIs1SHOTfalsefalse520231225_183839__67600.0039779410.17740[107, 456]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__AsIs__1SHOT__20231225_183839__676.json0.0missingmissingmissing
1420Apple-MacBook-Pro-M1audi_filtermistral-medium--optimAsIs1SHOTfalsefalse520231215_190415__55000.040.31430[107, 477]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__AsIs__1SHOT__20231215_190415__550.json0.00.9missing0.3
1421Apple-MacBook-Pro-M1audi_filtermistral-mediumInJulia1SHOTtruefalse520231213_212637__85400.0023680423.22790[110, 256]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__InJulia__1SHOT__20231213_212637__854.json25.0missingmissingmissing
1422Apple-MacBook-Pro-M1audi_filtermistral-mediumInJulia1SHOTtruetrue520231225_183800__85600.00199598.29140[110, 210]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__InJulia__1SHOT__20231225_183800__856.json50.0missingmissingmissing
1423Apple-MacBook-Pro-M1audi_filtermistral-mediumInJulia1SHOTtruetrue520231225_183823__81500.0027725422.47590[110, 306]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__InJulia__1SHOT__20231225_183823__815.json50.0missingmissingmissing
1424Apple-MacBook-Pro-M1audi_filtermistral-mediumInJulia1SHOTtruefalse520231227_191021__59800.0026673711.53120[110, 293]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__InJulia__1SHOT__20231227_191021__598.json25.0missingmissingmissing
1425Apple-MacBook-Pro-M1audi_filtermistral-mediumInJulia1SHOTtruetrue520231227_191031__32400.00256229.276290[110, 280]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__InJulia__1SHOT__20231227_191031__324.json50.0missingmissingmissing
1426Apple-MacBook-Pro-M1audi_filtermistral-medium--optimInJulia1SHOTtruetrue520231215_190334__45200.025.08940[110, 299]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__InJulia__1SHOT__20231215_190334__452.json50.00.9missing0.3
1427Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertAsk1SHOTtruefalse520231213_212614__28300.0018746816.1330[149, 182]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_212614__283.json25.0missingmissingmissing
1428Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_183739__16400.002958747.146810[149, 316]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_183739__164.json25.0missingmissingmissing
1429Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_183752__93900.0025299713.03390[149, 263]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_183752__939.json25.0missingmissingmissing
1430Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_190951__84500.0020122117.28130[149, 199]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_190951__845.json25.0missingmissingmissing
1431Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_191010__43900.0023196318.85150[149, 237]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_191010__439.json25.0missingmissingmissing
1432Apple-MacBook-Pro-M1audi_filtermistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_190309__16300.028.54380[149, 343]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_190309__163.json50.00.9missing0.3
1433Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_212558__89500.0056910351.57850[319, 597]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212558__895.json50.0missingmissingmissing
1434Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_183706__58700.0062249730.8890[319, 663]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183706__587.json50.0missingmissingmissing
1435Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_183732__79800.0047525924.54350[319, 481]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183732__798.json50.0missingmissingmissing
1436Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_190901__35500.0037656114.05840[319, 359]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190901__355.json25.0missingmissingmissing
1437Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_190933__62100.005310832.12450[319, 550]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190933__621.json50.0missingmissingmissing
1438Apple-MacBook-Pro-M1audi_filtermistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_190241__33400.051.98230[319, 474]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190241__334.json50.00.9missing0.3
1439Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_212841__77700.0059825854.3580[412, 602]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212841__777.json50.0missingmissingmissing
1440Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_183928__67400.0063142722.50430[412, 643]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183928__674.json50.0missingmissingmissing
1441Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_183940__73600.0054729112.37950[412, 539]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183940__736.json25.0missingmissingmissing
1442Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_191206__66600.005319233.96640[412, 520]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191206__666.json50.0missingmissingmissing
1443Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231227_191230__60200.0039196323.59770[412, 347]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191230__602.json25.0missingmissingmissing
1444Apple-MacBook-Pro-M1audi_filtermistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190609__77800.069.68630[412, 826]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190609__778.json50.00.9missing0.3
1445Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapTask1SHOTtruetrue520231213_212746__24500.0055214447.05550[409, 546]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_212746__245.json50.0missingmissingmissing
1446Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_183853__50150.0059825713.89662[409, 603]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_183853__501.json100.0missingmissingmissing
1447Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_183905__14250.0043888411.42232[409, 406]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_183905__142.json100.0missingmissingmissing
1448Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapTask1SHOTtruefalse520231227_191101__83800.0052787430.86020[409, 516]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_191101__838.json25.0missingmissingmissing
1449Apple-MacBook-Pro-M1audi_filtermistral-mediumJuliaRecapTask1SHOTtruetrue520231227_191132__19400.0052706530.76810[409, 515]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_191132__194.json50.0missingmissingmissing
1450Apple-MacBook-Pro-M1audi_filtermistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_190459__86100.044.14350[409, 546]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_190459__861.json50.00.9missing0.3
1451Apple-MacBook-Pro-M1audi_filtermistral-smallAsIs1SHOTfalsefalse520231213_212451__36400.0005206033.244750[109, 232]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__AsIs__1SHOT__20231213_212451__364.json0.0missingmissingmissing
1452Apple-MacBook-Pro-M1audi_filtermistral-smallAsIs1SHOTfalsefalse520231225_183545__62600.0005729833.54380[109, 259]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__AsIs__1SHOT__20231225_183545__626.json0.0missingmissingmissing
1453Apple-MacBook-Pro-M1audi_filtermistral-smallAsIs1SHOTfalsefalse520231225_183551__60600.0008542835.400470[109, 404]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__AsIs__1SHOT__20231225_183551__606.json0.0missingmissingmissing
1454Apple-MacBook-Pro-M1audi_filtermistral-small--optimAsIs1SHOTfalsefalse520231215_190135__63100.04.804020[109, 367]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__AsIs__1SHOT__20231215_190135__631.json0.00.9missing0.3
1455Apple-MacBook-Pro-M1audi_filtermistral-smallInJulia1SHOTtruetrue520231213_212448__46500.0009241245.993540[112, 439]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__InJulia__1SHOT__20231213_212448__465.json50.0missingmissingmissing
1456Apple-MacBook-Pro-M1audi_filtermistral-smallInJulia1SHOTtruetrue520231225_183536__49200.001253928.191060[112, 609]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__InJulia__1SHOT__20231225_183536__492.json50.0missingmissingmissing
1457Apple-MacBook-Pro-M1audi_filtermistral-smallInJulia1SHOTtruetrue520231225_183542__27700.0007902645.089680[112, 370]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__InJulia__1SHOT__20231225_183542__277.json50.0missingmissingmissing
1458Apple-MacBook-Pro-M1audi_filtermistral-smallInJulia1SHOTtruetrue520231227_190804__64000.0007902644.97940[112, 370]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__InJulia__1SHOT__20231227_190804__640.json50.0missingmissingmissing
1459Apple-MacBook-Pro-M1audi_filtermistral-smallInJulia1SHOTtruetrue520231227_190809__58600.0007592244.798610[112, 354]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__InJulia__1SHOT__20231227_190809__586.json50.0missingmissingmissing
1460Apple-MacBook-Pro-M1audi_filtermistral-small--optimInJulia1SHOTtruetrue520231215_190131__65000.05.490550[112, 411]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__InJulia__1SHOT__20231215_190131__650.json50.00.9missing0.3
1461Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertAsk1SHOTtruetrue520231213_212442__73500.0004831112.715320[153, 198]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_212442__735.json50.0missingmissingmissing
1462Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_183525__89100.0004966912.840760[153, 205]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_183525__891.json50.0missingmissingmissing
1463Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_183528__47500.0004462512.609640[153, 179]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_183528__475.json50.0missingmissingmissing
1464Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_190756__90600.0004772912.883280[153, 195]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_190756__906.json50.0missingmissingmissing
1465Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_190759__41700.0004811712.772050[153, 197]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_190759__417.json50.0missingmissingmissing
1466Apple-MacBook-Pro-M1audi_filtermistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_190125__82500.02.732710[153, 199]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_190125__825.json50.00.9missing0.3
1467Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_212439__49300.001154416.487790[333, 484]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212439__493.json50.0missingmissingmissing
1468Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231225_183516__73500.0003958711.442450[333, 93]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183516__735.json0.0missingmissingmissing
1469Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_183522__72600.001057416.059110[333, 434]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183522__726.json50.0missingmissingmissing
1470Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_190744__24100.001375578.318730[333, 598]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190744__241.json50.0missingmissingmissing
1471Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_190753__24200.001220378.236520[333, 518]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190753__242.json50.0missingmissingmissing
1472Apple-MacBook-Pro-M1audi_filtermistral-small--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_190122__82600.07.729230[333, 577]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190122__826.json0.00.9missing0.3
1473Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_212506__17700.001206176.622420[419, 482]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212506__177.json50.0missingmissingmissing
1474Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_183621__62100.0016504314.86810[419, 711]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183621__621.json50.0missingmissingmissing
1475Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_183635__82300.00095785314.46491[419, 354]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183635__823.json62.5missingmissingmissing
1476Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapCoTTask1SHOTtruefalse520231227_190841__18400.001244976.843060[419, 502]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190841__184.json25.0missingmissingmissing
1477Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_190847__69650.001116936.104652[419, 436]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190847__696.json100.0missingmissingmissing
1478Apple-MacBook-Pro-M1audi_filtermistral-small--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190149__22200.07.063840[419, 526]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190149__222.json50.00.9missing0.3
1479Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapTask1SHOTtruefalse520231213_212459__81600.001441568.327530[417, 604]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_212459__816.json25.0missingmissingmissing
1480Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapTask1SHOTtruetrue520231225_183559__51700.001449328.255610[417, 608]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_183559__517.json50.0missingmissingmissing
1481Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapTask1SHOTtruetrue520231225_183606__84200.001224286.678910[417, 492]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_183606__842.json50.0missingmissingmissing
1482Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapTask1SHOTtruetrue520231227_190821__62700.0020371412.33550[417, 911]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_190821__627.json50.0missingmissingmissing
1483Apple-MacBook-Pro-M1audi_filtermistral-smallJuliaRecapTask1SHOTtruetrue520231227_190834__89900.0013988812.86270[417, 582]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_190834__899.json50.0missingmissingmissing
1484Apple-MacBook-Pro-M1audi_filtermistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_190141__71900.05.906341[417, 440]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_190141__719.json62.50.9missing0.3
1485Apple-MacBook-Pro-M1audi_filtermistral-tinyAsIs1SHOTfalsefalse520231213_212418__47800.0001452714.231510[109, 287]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__AsIs__1SHOT__20231213_212418__478.json0.0missingmissingmissing
1486Apple-MacBook-Pro-M1audi_filtermistral-tinyAsIs1SHOTfalsefalse520231225_183454__82800.0001180912.068540[109, 227]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__AsIs__1SHOT__20231225_183454__828.json0.0missingmissingmissing
1487Apple-MacBook-Pro-M1audi_filtermistral-tinyAsIs1SHOTfalsefalse520231225_183458__30100.0001796993.325650[109, 363]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__AsIs__1SHOT__20231225_183458__301.json0.0missingmissingmissing
1488Apple-MacBook-Pro-M1audi_filtermistral-tiny--optimAsIs1SHOTfalsefalse520231215_190109__39200.01.753610[109, 204]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__AsIs__1SHOT__20231215_190109__392.json0.00.9missing0.3
1489Apple-MacBook-Pro-M1audi_filtermistral-tinyInJulia1SHOTtruetrue520231213_212414__52900.0002829510.18470[112, 590]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__InJulia__1SHOT__20231213_212414__529.json50.0missingmissingmissing
1490Apple-MacBook-Pro-M1audi_filtermistral-tinyInJulia1SHOTfalsefalse520231225_183448__19200.0002190774.106390[112, 449]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__InJulia__1SHOT__20231225_183448__192.json0.0missingmissingmissing
1491Apple-MacBook-Pro-M1audi_filtermistral-tinyInJulia1SHOTtruetrue520231225_183452__62800.0002032223.697480[112, 414]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__InJulia__1SHOT__20231225_183452__628.json50.0missingmissingmissing
1492Apple-MacBook-Pro-M1audi_filtermistral-tinyInJulia1SHOTtruetrue520231227_190714__99600.0002394624.461370[112, 494]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__InJulia__1SHOT__20231227_190714__996.json50.0missingmissingmissing
1493Apple-MacBook-Pro-M1audi_filtermistral-tinyInJulia1SHOTfalsefalse520231227_190717__92400.0001533922.829550[112, 304]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__InJulia__1SHOT__20231227_190717__924.json0.0missingmissingmissing
1494Apple-MacBook-Pro-M1audi_filtermistral-tiny--optimInJulia1SHOTtruetrue520231215_190107__63600.03.549990[112, 425]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__InJulia__1SHOT__20231215_190107__636.json50.00.9missing0.3
1495Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_212404__34206.4002e-51.763760[153, 94]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_212404__342.json50.0missingmissingmissing
1496Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_183443__87806.1737e-50.8862660[153, 89]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_183443__878.json0.0missingmissingmissing
1497Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_183444__75906.4002e-50.9980940[153, 94]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_183444__759.json0.0missingmissingmissing
1498Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231227_190708__99106.5814e-51.060410[153, 98]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_190708__991.json0.0missingmissingmissing
1499Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231227_190709__14907.2156e-51.185540[153, 112]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_190709__149.json0.0missingmissingmissing
1500Apple-MacBook-Pro-M1audi_filtermistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_190103__41700.00.8678420[153, 89]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_190103__417.json50.00.9missing0.3
1501Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231213_212402__25150.0003591912.422[333, 690]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212402__251.json100.0missingmissingmissing
1502Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_183437__33800.00028942810.02030[333, 536]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183437__338.json50.0missingmissingmissing
1503Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_183442__91100.0002753854.719290[333, 505]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183442__911.json0.0missingmissingmissing
1504Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_190703__51000.0002386928.643450[333, 424]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190703__510.json50.0missingmissingmissing
1505Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231227_190707__58800.0002337093.847020[333, 413]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_190707__588.json0.0missingmissingmissing
1506Apple-MacBook-Pro-M1audi_filtermistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_190103__85700.05.952090[333, 341]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190103__857.json50.00.9missing0.3
1507Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_212432__93700.0002117745.863870[419, 338]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212432__937.json50.0missingmissingmissing
1508Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231225_183512__70900.0002688524.332070[419, 464]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183512__709.json0.0missingmissingmissing
1509Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231225_183515__92800.000194562.830860[419, 300]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_183515__928.json0.0missingmissingmissing
1510Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231227_190732__36400.0002416723.670150[419, 404]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190732__364.json0.0missingmissingmissing
1511Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_190736__10400.0002457493.671450[419, 413]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_190736__104.json50.0missingmissingmissing
1512Apple-MacBook-Pro-M1audi_filtermistral-tiny--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_190114__10900.02.589390[419, 304]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190114__109.json0.00.9missing0.3
1513Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapTask1SHOTtruetrue520231213_212426__37000.0003351637.389530[417, 611]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_212426__370.json50.0missingmissingmissing
1514Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapTask1SHOTtruetrue520231225_183502__87200.0002731024.51560[417, 474]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_183502__872.json50.0missingmissingmissing
1515Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapTask1SHOTtruefalse520231225_183508__43700.0002962055.032730[417, 525]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_183508__437.json25.0missingmissingmissing
1516Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapTask1SHOTfalsefalse520231227_190722__29900.000307535.215850[417, 550]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_190722__299.json0.0missingmissingmissing
1517Apple-MacBook-Pro-M1audi_filtermistral-tinyJuliaRecapTask1SHOTtruetrue520231227_190728__96000.0003161375.430370[417, 569]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_190728__960.json50.0missingmissingmissing
1518Apple-MacBook-Pro-M1audi_filtermistral-tiny--optimJuliaRecapTask1SHOTfalsefalse520231215_190112__82000.02.695940[417, 313]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_190112__820.json0.00.9missing0.3
1519Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_213344__59300.016.21870[95, 473]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_213344__593.json0.0missingmissingmissing
1520Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_213358__98400.013.80250[1, 422]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_213358__984.json0.0missingmissingmissing
1521Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_213407__13600.09.280150[1, 290]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_213407__136.json0.0missingmissingmissing
1522Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231224_233731__59500.011.26890[108, 276]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_233731__595.json0.0missing{\n "num_gpu": 99\n}missing
1523Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231224_233744__83000.012.79610[108, 316]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231224_233744__830.json0.0missing{\n "num_gpu": 99\n}missing
1524Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_213311__61800.016.56160[1, 499]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_213311__618.json0.0missingmissingmissing
1525Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_213328__16000.016.2820[1, 491]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_213328__160.json25.0missingmissingmissing
1526Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231224_233708__46300.03.674770[111, 79]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_233708__463.json0.0missing{\n "num_gpu": 99\n}missing
1527Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231224_233720__80600.011.45930[111, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231224_233720__806.json50.0missing{\n "num_gpu": 99\n}missing
1528Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_214023__65200.08.59890[111, 207]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_214023__652.json50.0missing{\n "num_gpu": 99\n}missing
1529Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_213227__46100.017.21950[1, 511]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213227__461.json25.0missingmissingmissing
1530Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_213235__83100.08.554770[1, 265]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213235__831.json0.0missingmissingmissing
1531Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231224_233700__27600.03.540850[152, 71]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233700__276.json0.0missing{\n "num_gpu": 99\n}missing
1532Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233704__66800.04.045860[152, 84]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233704__668.json50.0missing{\n "num_gpu": 99\n}missing
1533Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_214015__46700.06.75310[152, 154]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_214015__467.json50.0missing{\n "num_gpu": 99\n}missing
1534Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213131__96800.028.73510[1, 774]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213131__968.json0.0missingmissingmissing
1535Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213154__28200.022.43630[1, 619]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213154__282.json0.0missingmissingmissing
1536Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231224_233641__32800.016.9330[332, 244]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233641__328.json50.0missing{\n "num_gpu": 99\n}missing
1537Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231224_233657__26700.016.16020[332, 362]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233657__267.json0.0missing{\n "num_gpu": 99\n}missing
1538Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_214008__36500.030.54040[332, 582]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_214008__365.json50.0missing{\n "num_gpu": 99\n}missing
1539Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_213610__86800.019.14210[1, 521]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213610__868.json50.0missingmissingmissing
1540Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_213630__33800.020.19930[1, 547]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213630__338.json0.0missingmissingmissing
1541Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_233826__78300.015.41930[419, 329]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233826__783.json50.0missing{\n "num_gpu": 99\n}missing
1542Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231224_233842__54700.015.94890[419, 342]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233842__547.json0.0missing{\n "num_gpu": 99\n}missing
1543Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231226_214126__87300.028.73420[419, 649]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_214126__873.json0.0missing{\n "num_gpu": 99\n}missing
1544Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_213508__31500.028.65650[1, 753]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_213508__315.json0.0missingmissingmissing
1545Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_213532__98200.023.24810[1, 623]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_213532__982.json0.0missingmissingmissing
1546Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231224_233752__62800.08.059310[417, 146]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233752__628.json0.0missing{\n "num_gpu": 99\n}missing
1547Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231224_233811__44100.018.47260[417, 404]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233811__441.json0.0missing{\n "num_gpu": 99\n}missing
1548Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_214057__89900.033.48940[417, 760]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_214057__899.json50.0missing{\n "num_gpu": 99\n}missing
1549Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_223421__49000.013.79610[110, 431]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223421__490.json0.0missing{\n "num_gpu": 99\n}missing
1550Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223432__20700.010.82640[110, 336]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223432__207.json50.0missing{\n "num_gpu": 99\n}missing
1551Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223443__53200.010.2090[110, 316]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223443__532.json50.0missing{\n "num_gpu": 99\n}missing
1552Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223453__64200.010.52130[110, 326]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223453__642.json50.0missing{\n "num_gpu": 99\n}missing
1553Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_223502__36500.07.570160[110, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_223502__365.json50.0missing{\n "num_gpu": 99\n}missing
1554Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_223352__24100.04.008050[151, 108]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223352__241.json0.0missing{\n "num_gpu": 99\n}missing
1555Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_223355__14400.03.259640[151, 84]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223355__144.json50.0missing{\n "num_gpu": 99\n}missing
1556Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_223359__31500.03.532850[151, 93]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223359__315.json0.0missing{\n "num_gpu": 99\n}missing
1557Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_223403__36600.03.935640[151, 106]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223403__366.json0.0missing{\n "num_gpu": 99\n}missing
1558Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_223407__37100.04.054860[151, 110]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_223407__371.json50.0missing{\n "num_gpu": 99\n}missing
1559Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_223252__28100.012.96090[331, 286]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223252__281.json50.0missing{\n "num_gpu": 99\n}missing
1560Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_223307__93900.014.56060[331, 410]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223307__939.json0.0missing{\n "num_gpu": 99\n}missing
1561Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_223320__44600.013.08760[331, 365]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223320__446.json0.0missing{\n "num_gpu": 99\n}missing
1562Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_223337__36350.017.41092[331, 497]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223337__363.json100.0missing{\n "num_gpu": 99\n}missing
1563Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_223347__83900.09.320010[331, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223347__839.json50.0missing{\n "num_gpu": 99\n}missing
1564Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_223644__25300.011.48230[418, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223644__253.json0.0missing{\n "num_gpu": 99\n}missing
1565Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223657__51100.013.43460[418, 358]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223657__511.json50.0missing{\n "num_gpu": 99\n}missing
1566Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223711__31200.013.59210[418, 363]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223711__312.json50.0missing{\n "num_gpu": 99\n}missing
1567Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223727__73400.015.86530[418, 432]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223727__734.json50.0missing{\n "num_gpu": 99\n}missing
1568Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_223740__74300.012.32640[418, 324]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_223740__743.json50.0missing{\n "num_gpu": 99\n}missing
1569Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223528__81800.026.5240[416, 749]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223528__818.json50.0missing{\n "num_gpu": 99\n}missing
1570Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223541__85500.012.91430[416, 347]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223541__855.json50.0missing{\n "num_gpu": 99\n}missing
1571Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223606__57500.024.14320[416, 679]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223606__575.json50.0missing{\n "num_gpu": 99\n}missing
1572Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223620__72900.014.0610[416, 381]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223620__729.json50.0missing{\n "num_gpu": 99\n}missing
1573Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_223632__42150.011.36792[416, 299]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_223632__421.json100.0missing{\n "num_gpu": 99\n}missing
1574Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_224037__95500.015.14250[110, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224037__955.json50.0missing{\n "num_gpu": 99\n}missing
1575Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_224053__40300.014.51930[110, 357]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224053__403.json0.0missing{\n "num_gpu": 99\n}missing
1576Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_224104__37200.011.43350[110, 279]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224104__372.json0.0missing{\n "num_gpu": 99\n}missing
1577Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_224118__72200.014.43210[110, 355]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224118__722.json0.0missing{\n "num_gpu": 99\n}missing
1578Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_224134__74200.015.76170[110, 389]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_224134__742.json0.0missing{\n "num_gpu": 99\n}missing
1579Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_223948__41700.09.812540[151, 232]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_223948__417.json50.0missing{\n "num_gpu": 99\n}missing
1580Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_223954__78600.05.54040[151, 122]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_223954__786.json0.0missing{\n "num_gpu": 99\n}missing
1581Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_224011__46500.016.67350[151, 406]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_224011__465.json50.0missing{\n "num_gpu": 99\n}missing
1582Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_224017__65900.05.264890[151, 115]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_224017__659.json0.0missing{\n "num_gpu": 99\n}missing
1583Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_224022__59600.05.022280[151, 109]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_224022__596.json50.0missing{\n "num_gpu": 99\n}missing
1584Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_223803__11700.022.36780[331, 492]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223803__117.json0.0missing{\n "num_gpu": 99\n}missing
1585Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223830__11700.026.9340[331, 622]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223830__117.json50.0missing{\n "num_gpu": 99\n}missing
1586Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223848__99800.018.45230[331, 417]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223848__998.json50.0missing{\n "num_gpu": 99\n}missing
1587Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223909__72600.020.50140[331, 467]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223909__726.json50.0missing{\n "num_gpu": 99\n}missing
1588Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_223938__55200.028.70540[331, 664]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_223938__552.json50.0missing{\n "num_gpu": 99\n}missing
1589Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_224434__41300.023.06810[418, 512]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224434__413.json50.0missing{\n "num_gpu": 99\n}missing
1590Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_224459__90800.024.57780[418, 548]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224459__908.json25.0missing{\n "num_gpu": 99\n}missing
1591Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_224521__97500.022.23180[418, 492]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224521__975.json0.0missing{\n "num_gpu": 99\n}missing
1592Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_224550__87800.028.75740[418, 647]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224550__878.json0.0missing{\n "num_gpu": 99\n}missing
1593Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_224605__50600.015.12880[418, 320]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224605__506.json50.0missing{\n "num_gpu": 99\n}missing
1594Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_224211__74600.037.10380[416, 844]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224211__746.json50.0missing{\n "num_gpu": 99\n}missing
1595Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_224233__75600.021.13160[416, 469]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224233__756.json50.0missing{\n "num_gpu": 99\n}missing
1596Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_224302__42500.028.56960[416, 646]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224302__425.json0.0missing{\n "num_gpu": 99\n}missing
1597Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_224333__29100.030.81440[416, 699]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224333__291.json0.0missing{\n "num_gpu": 99\n}missing
1598Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_224411__41500.038.08310[416, 867]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_224411__415.json0.0missing{\n "num_gpu": 99\n}missing
1599Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_115916__36900.015.01640[107, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_115916__369.json0.0missing{\n "num_gpu": 99\n}missing
1600Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_115932__27800.015.74360[107, 272]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_115932__278.json0.0missing{\n "num_gpu": 99\n}missing
1601Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_115844__73800.015.7560[110, 279]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115844__738.json0.0missing{\n "num_gpu": 99\n}missing
1602Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_115901__34900.017.5760[110, 307]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_115901__349.json0.0missing{\n "num_gpu": 99\n}missing
1603Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_215211__43000.034.13860[110, 622]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_215211__430.json50.0missing{\n "num_gpu": 99\n}missing
1604Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_115822__12800.05.627520[151, 88]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115822__128.json50.0missing{\n "num_gpu": 99\n}missing
1605Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_115828__79800.06.034320[151, 95]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_115828__798.json0.0missing{\n "num_gpu": 99\n}missing
1606Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_215137__39100.05.566760[151, 89]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_215137__391.json0.0missing{\n "num_gpu": 99\n}missing
1607Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_115746__60500.050.21330[331, 855]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115746__605.json0.0missing{\n "num_gpu": 99\n}missing
1608Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_115816__82200.029.33490[331, 496]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_115816__822.json50.0missing{\n "num_gpu": 99\n}missing
1609Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_215132__98000.038.87990[331, 514]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215132__980.json0.0missing{\n "num_gpu": 99\n}missing
1610Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_120102__13100.018.23930[418, 288]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120102__131.json0.0missing{\n "num_gpu": 99\n}missing
1611Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120131__26200.028.94660[418, 480]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120131__262.json50.0missing{\n "num_gpu": 99\n}missing
1612Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_215332__84700.042.08640[418, 715]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215332__847.json0.0missing{\n "num_gpu": 99\n}missing
1613Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_120006__94100.033.86020[416, 558]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120006__941.json0.0missing{\n "num_gpu": 99\n}missing
1614Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120044__87000.037.38070[416, 631]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120044__870.json50.0missing{\n "num_gpu": 99\n}missing
1615Apple-MacBook-Pro-M1audi_filtermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_215249__37600.037.29720[416, 633]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_215249__376.json0.0missing{\n "num_gpu": 99\n}missing
1616Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_102046__38800.039.74571[116, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_102046__388.json62.5missing{\n "num_gpu": 99\n}missing
1617Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_102132__79800.045.49510[116, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_102132__798.json50.0missing{\n "num_gpu": 99\n}missing
1618Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_102204__52350.031.40112[116, 175]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_102204__523.json100.0missing{\n "num_gpu": 99\n}missing
1619Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142103__62400.056.35270[116, 325]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142103__624.json50.0missing{\n "num_gpu": 99\n}missing
1620Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142156__42400.052.5290[116, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142156__424.json50.0missing{\n "num_gpu": 99\n}missing
1621Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_101845__46800.014.18090[155, 64]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_101845__468.json0.0missing{\n "num_gpu": 99\n}missing
1622Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_101937__78800.052.55250[155, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_101937__788.json50.0missing{\n "num_gpu": 99\n}missing
1623Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_102006__23500.028.34060[155, 151]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_102006__235.json0.0missing{\n "num_gpu": 99\n}missing
1624Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_141947__16200.019.35160[155, 95]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_141947__162.json0.0missing{\n "num_gpu": 99\n}missing
1625Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_142007__69800.020.44960[155, 102]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_142007__698.json0.0missing{\n "num_gpu": 99\n}missing
1626Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_101623__80200.0142.620[343, 760]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101623__802.json50.0missing{\n "num_gpu": 99\n}missing
1627Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_101708__24100.043.59890[343, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101708__241.json0.0missing{\n "num_gpu": 99\n}missing
1628Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_101830__12500.082.45440[343, 440]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_101830__125.json50.0missing{\n "num_gpu": 99\n}missing
1629Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_141740__49400.0136.5690[343, 746]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_141740__494.json50.0missing{\n "num_gpu": 99\n}missing
1630Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_141927__89600.0106.2210[343, 574]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_141927__896.json50.0missing{\n "num_gpu": 99\n}missing
1631Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_102758__75850.062.26282[429, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_102758__758.json100.0missing{\n "num_gpu": 99\n}missing
1632Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_102849__19200.050.67560[429, 232]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_102849__192.json50.0missing{\n "num_gpu": 99\n}missing
1633Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_102917__79100.027.75080[429, 97]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_102917__791.json50.0missing{\n "num_gpu": 99\n}missing
1634Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_142501__39940.060.28492[429, 289]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_142501__399.json95.0missing{\n "num_gpu": 99\n}missing
1635Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_142631__29600.089.42770[429, 458]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_142631__296.json50.0missing{\n "num_gpu": 99\n}missing
1636Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_102346__87200.0101.6440[427, 531]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_102346__872.json50.0missing{\n "num_gpu": 99\n}missing
1637Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_102500__54600.073.52090[427, 369]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_102500__546.json50.0missing{\n "num_gpu": 99\n}missing
1638Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_102654__25000.0114.1230[427, 576]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_102654__250.json50.0missing{\n "num_gpu": 99\n}missing
1639Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_142248__20600.051.14020[427, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_142248__206.json50.0missing{\n "num_gpu": 99\n}missing
1640Apple-MacBook-Pro-M1audi_filternous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_142400__45250.071.52772[427, 355]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_142400__452.json100.0missing{\n "num_gpu": 99\n}missing
1641Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_213913__33900.015.2820[95, 446]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_213913__339.json0.0missingmissingmissing
1642Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_213929__53100.016.04260[1, 485]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_213929__531.json0.0missingmissingmissing
1643Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_213941__62700.011.69020[1, 361]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_213941__627.json0.0missingmissingmissing
1644Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231224_234009__84300.011.49240[116, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231224_234009__843.json0.0missing{\n "num_gpu": 99\n}missing
1645Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231224_234019__57700.010.1480[116, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231224_234019__577.json0.0missing{\n "num_gpu": 99\n}missing
1646Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_213840__72600.022.85240[1, 669]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_213840__726.json25.0missingmissingmissing
1647Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231219_213858__64000.018.30560[1, 547]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_213858__640.json50.0missingmissingmissing
1648Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231224_233946__78200.010.79870[119, 263]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_233946__782.json50.0missing{\n "num_gpu": 99\n}missing
1649Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231224_233957__12600.010.40820[119, 253]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231224_233957__126.json50.0missing{\n "num_gpu": 99\n}missing
1650Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231226_214205__55700.09.748590[119, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_214205__557.json50.0missing{\n "num_gpu": 99\n}missing
1651Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_213759__42000.013.43790[1, 406]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213759__420.json50.0missingmissingmissing
1652Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_213803__11500.04.492140[1, 142]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_213803__115.json0.0missingmissingmissing
1653Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233928__72100.04.703850[160, 101]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233928__721.json50.0missing{\n "num_gpu": 99\n}missing
1654Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233935__16600.06.907870[160, 158]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233935__166.json50.0missing{\n "num_gpu": 99\n}missing
1655Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_214156__58000.04.737350[160, 102]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_214156__580.json50.0missing{\n "num_gpu": 99\n}missing
1656Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213723__58800.034.31220[1, 906]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213723__588.json0.0missingmissingmissing
1657Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_213737__82900.013.71690[1, 392]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_213737__829.json0.0missingmissingmissing
1658Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231224_233904__19300.022.02110[340, 349]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233904__193.json25.0missing{\n "num_gpu": 99\n}missing
1659Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231224_233923__53940.018.30412[340, 414]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233923__539.json95.0missing{\n "num_gpu": 99\n}missing
1660Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_214151__74700.024.90210[340, 430]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_214151__747.json50.0missing{\n "num_gpu": 99\n}missing
1661Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_214140__83900.024.50330[1, 653]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214140__839.json50.0missingmissingmissing
1662Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_214147__96400.07.211360[1, 206]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214147__964.json0.0missingmissingmissing
1663Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231224_234106__31100.014.12380[427, 296]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234106__311.json0.0missing{\n "num_gpu": 99\n}missing
1664Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231224_234123__29000.016.47290[427, 354]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234123__290.json50.0missing{\n "num_gpu": 99\n}missing
1665Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231226_214244__62200.019.9760[427, 438]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_214244__622.json25.0missing{\n "num_gpu": 99\n}missing
1666Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_214023__42400.019.57820[1, 532]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_214023__424.json50.0missingmissingmissing
1667Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_214052__22800.029.29560[1, 768]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_214052__228.json0.0missingmissingmissing
1668Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_234037__73400.017.57820[425, 381]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_234037__734.json50.0missing{\n "num_gpu": 99\n}missing
1669Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_234052__28500.014.36030[425, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_234052__285.json50.0missing{\n "num_gpu": 99\n}missing
1670Apple-MacBook-Pro-M1audi_filteropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_214224__91300.018.10370[425, 393]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_214224__913.json50.0missing{\n "num_gpu": 99\n}missing
1671Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralAsIs1SHOTfalsefalse520231213_232006__49500.012.63860[95, 369]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231213_232006__495.json0.0missingmissingmissing
1672Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralAsIs1SHOTfalsefalse520231224_224431__74300.08.151190[114, 253]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231224_224431__743.json0.0missing{\n "num_gpu": 99\n}missing
1673Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralAsIs1SHOTfalsefalse520231224_224438__67700.07.44470[114, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231224_224438__677.json0.0missing{\n "num_gpu": 99\n}missing
1674Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTfalsefalse520231213_231953__59600.019.49050[112, 556]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_231953__596.json0.0missingmissingmissing
1675Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTtruetrue520231224_224416__98600.07.620960[117, 235]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_224416__986.json50.0missing{\n "num_gpu": 99\n}missing
1676Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTtruetrue520231224_224422__88900.05.867760[117, 177]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_224422__889.json50.0missing{\n "num_gpu": 99\n}missing
1677Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralInJulia1SHOTtruetrue520231226_211733__57600.09.624390[117, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_211733__576.json50.0missing{\n "num_gpu": 99\n}missing
1678Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231213_231934__96300.015.0210[141, 420]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_231934__963.json0.0missingmissingmissing
1679Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231224_224358__55600.010.63170[158, 327]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_224358__556.json50.0missing{\n "num_gpu": 99\n}missing
1680Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231224_224408__49900.09.635231[158, 296]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_224408__499.json62.5missing{\n "num_gpu": 99\n}missing
1681Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_211723__89800.06.368021[158, 189]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_211723__898.json62.5missing{\n "num_gpu": 99\n}missing
1682Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231213_231919__84400.021.11510[311, 516]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_231919__844.json0.0missingmissingmissing
1683Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231224_224329__34100.025.70760[338, 593]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224329__341.json25.0missing{\n "num_gpu": 99\n}missing
1684Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231224_224346__77900.017.31670[338, 498]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224346__779.json50.0missing{\n "num_gpu": 99\n}missing
1685Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_211716__84800.018.3340[338, 374]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211716__848.json50.0missing{\n "num_gpu": 99\n}missing
1686Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231213_232046__17200.017.62450[11, 475]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232046__172.json0.0missingmissingmissing
1687Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_224534__73000.021.33820[425, 599]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224534__730.json50.0missing{\n "num_gpu": 99\n}missing
1688Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_224547__73400.012.8720[425, 343]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224547__734.json50.0missing{\n "num_gpu": 99\n}missing
1689Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231226_211747__23700.02.449850[425, 15]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211747__237.json0.0missing{\n "num_gpu": 99\n}missing
1690Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231213_232028__38400.022.30440[412, 501]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_232028__384.json25.0missingmissingmissing
1691Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231224_224456__34800.017.40950[423, 484]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_224456__348.json50.0missing{\n "num_gpu": 99\n}missing
1692Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231224_224512__38600.016.46440[423, 456]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_224512__386.json0.0missing{\n "num_gpu": 99\n}missing
1693Apple-MacBook-Pro-M1audi_filteropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_211744__20240.010.47292[423, 272]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_211744__202.json95.0missing{\n "num_gpu": 99\n}missing
1694Apple-MacBook-Pro-M1audi_filterorca2:13bAsIs1SHOTfalsefalse520231213_233314__86200.024.45950[95, 693]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__AsIs__1SHOT__20231213_233314__862.json0.0missingmissingmissing
1695Apple-MacBook-Pro-M1audi_filterorca2:13bAsIs1SHOTfalsefalse520231224_231109__85400.014.96090[112, 263]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__AsIs__1SHOT__20231224_231109__854.json0.0missing{\n "num_gpu": 99\n}missing
1696Apple-MacBook-Pro-M1audi_filterorca2:13bAsIs1SHOTfalsefalse520231224_231128__87000.018.30970[112, 325]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__AsIs__1SHOT__20231224_231128__870.json0.0missing{\n "num_gpu": 99\n}missing
1697Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231213_233249__10600.013.98830[112, 402]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231213_233249__106.json0.0missingmissingmissing
1698Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231224_231038__29500.021.42860[115, 382]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231224_231038__295.json0.0missing{\n "num_gpu": 99\n}missing
1699Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231224_231054__61200.015.94520[115, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231224_231054__612.json0.0missing{\n "num_gpu": 99\n}missing
1700Apple-MacBook-Pro-M1audi_filterorca2:13bInJulia1SHOTfalsefalse520231226_212718__77800.02.963160[115, 37]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__InJulia__1SHOT__20231226_212718__778.json0.0missing{\n "num_gpu": 99\n}missing
1701Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231213_233235__67300.08.375480[141, 227]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231213_233235__673.json0.0missingmissingmissing
1702Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231224_231008__34000.07.602820[154, 120]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_231008__340.json0.0missing{\n "num_gpu": 99\n}missing
1703Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231224_231017__39200.08.544550[154, 137]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231224_231017__392.json0.0missing{\n "num_gpu": 99\n}missing
1704Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_212715__46500.08.506670[154, 136]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_212715__465.json0.0missing{\n "num_gpu": 99\n}missing
1705Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231213_233227__41200.026.17470[311, 644]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233227__412.json0.0missingmissingmissing
1706Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231224_230944__45500.032.05090[324, 354]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230944__455.json0.0missing{\n "num_gpu": 99\n}missing
1707Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231224_231001__15900.017.00120[324, 260]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231224_231001__159.json0.0missing{\n "num_gpu": 99\n}missing
1708Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_212706__28600.022.63130[324, 199]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212706__286.json0.0missing{\n "num_gpu": 99\n}missing
1709Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231213_233354__78700.015.81570[11, 429]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233354__787.json50.0missingmissingmissing
1710Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231224_231257__88200.028.04750[418, 435]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_231257__882.json0.0missing{\n "num_gpu": 99\n}missing
1711Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231224_231324__84800.027.08710[418, 418]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231224_231324__848.json0.0missing{\n "num_gpu": 99\n}missing
1712Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231226_212834__33700.042.80940[418, 685]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212834__337.json0.0missing{\n "num_gpu": 99\n}missing
1713Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTfalsefalse520231213_233338__86800.024.7940[412, 564]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231213_233338__868.json0.0missingmissingmissing
1714Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTtruetrue520231224_231205__71400.037.48360[415, 598]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_231205__714.json50.0missing{\n "num_gpu": 99\n}missing
1715Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTtruetrue520231224_231229__97100.023.25190[415, 356]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231224_231229__971.json50.0missing{\n "num_gpu": 99\n}missing
1716Apple-MacBook-Pro-M1audi_filterorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_212751__68300.033.88620[415, 540]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_212751__683.json0.0missing{\n "num_gpu": 99\n}missing
1717Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_214429__88200.022.16990[95, 635]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_214429__882.json0.0missingmissingmissing
1718Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_214443__55600.013.80190[1, 422]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_214443__556.json0.0missingmissingmissing
1719Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_214506__73600.023.4550[1, 685]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_214506__736.json0.0missingmissingmissing
1720Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231224_234257__80100.024.31560[109, 892]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231224_234257__801.json0.0missing{\n "num_gpu": 99\n}missing
1721Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231224_234300__64100.02.258110[109, 78]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231224_234300__641.json0.0missing{\n "num_gpu": 99\n}missing
1722Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_214326__95400.015.0610[112, 435]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_214326__954.json25.0missingmissingmissing
1723Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_214344__97100.017.78680[1, 533]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_214344__971.json0.0missingmissingmissing
1724Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_214407__15100.023.11370[1, 676]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_214407__151.json25.0missingmissingmissing
1725Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231224_234221__55100.024.06570[112, 883]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_234221__551.json0.0missing{\n "num_gpu": 99\n}missing
1726Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231224_234233__45800.011.63010[112, 441]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231224_234233__458.json0.0missing{\n "num_gpu": 99\n}missing
1727Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_214306__92200.015.68480[1, 469]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_214306__922.json0.0missingmissingmissing
1728Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_214311__61100.04.921290[1, 155]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_214311__611.json0.0missingmissingmissing
1729Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231224_234152__30200.015.80270[149, 586]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_234152__302.json0.0missing{\n "num_gpu": 99\n}missing
1730Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231224_234157__33900.05.013820[149, 182]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231224_234157__339.json0.0missing{\n "num_gpu": 99\n}missing
1731Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_214323__91500.029.02510[149, 1035]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_214323__915.json0.0missing{\n "num_gpu": 99\n}missing
1732Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_214224__85500.014.70610[1, 419]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214224__855.json0.0missingmissingmissing
1733Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_214240__88400.015.43390[1, 438]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214240__884.json0.0missingmissingmissing
1734Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231224_234132__89400.08.793920[318, 157]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234132__894.json0.0missing{\n "num_gpu": 99\n}missing
1735Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231224_234137__26700.04.356880[318, 130]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234137__267.json0.0missing{\n "num_gpu": 99\n}missing
1736Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_214254__22000.09.132630[318, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_214254__220.json0.0missing{\n "num_gpu": 99\n}missing
1737Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231219_214633__20800.021.08810[11, 564]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214633__208.json0.0missingmissingmissing
1738Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231219_214651__48030.017.8862[1, 489]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214651__480.json90.0missingmissingmissing
1739Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231219_214708__99900.017.29440[1, 474]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_214708__999.json0.0missingmissingmissing
1740Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231224_234340__18500.010.51590[401, 340]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234340__185.json50.0missing{\n "num_gpu": 99\n}missing
1741Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231224_234349__72000.08.877950[401, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234349__720.json0.0missing{\n "num_gpu": 99\n}missing
1742Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_214530__93800.023.47960[412, 533]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_214530__938.json50.0missingmissingmissing
1743Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_214554__57100.023.86730[1, 638]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_214554__571.json50.0missingmissingmissing
1744Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_214612__40000.017.7540[1, 486]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_214612__400.json50.0missingmissingmissing
1745Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231224_234326__79000.026.21330[398, 872]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_234326__790.json0.0missing{\n "num_gpu": 99\n}missing
1746Apple-MacBook-Pro-M1audi_filterphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231224_234329__78400.03.592310[398, 86]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231224_234329__784.json50.0missing{\n "num_gpu": 99\n}missing
1747Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2AsIs1SHOTfalsefalse520231213_233454__33800.018.64510[95, 537]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231213_233454__338.json0.0missingmissingmissing
1748Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2AsIs1SHOTfalsefalse520231224_231853__69400.034.65050[120, 260]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231224_231853__694.json0.0missing{\n "num_gpu": 99\n}missing
1749Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2AsIs1SHOTfalsefalse520231224_231939__93900.045.95650[120, 350]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231224_231939__939.json0.0missing{\n "num_gpu": 99\n}missing
1750Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTtruefalse520231213_233436__89800.015.1240[112, 434]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231213_233436__898.json25.0missingmissingmissing
1751Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTtruetrue520231224_231743__43740.054.31852[123, 416]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_231743__437.json95.0missing{\n "num_gpu": 99\n}missing
1752Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTtruetrue520231224_231818__63550.033.65942[123, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231224_231818__635.json100.0missing{\n "num_gpu": 99\n}missing
1753Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2InJulia1SHOTfalsefalse520231226_213108__69200.033.05070[123, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_213108__692.json0.0missing{\n "num_gpu": 99\n}missing
1754Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231213_233421__63600.04.658780[141, 115]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231213_233421__636.json50.0missingmissingmissing
1755Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231224_231559__40650.023.51172[162, 160]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_231559__406.json100.0missing{\n "num_gpu": 99\n}missing
1756Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231224_231649__99300.049.3150[162, 365]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231224_231649__993.json50.0missing{\n "num_gpu": 99\n}missing
1757Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_213034__97300.045.13720[162, 331]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_213034__973.json50.0missing{\n "num_gpu": 99\n}missing
1758Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231213_233416__66100.021.04270[311, 513]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233416__661.json0.0missingmissingmissing
1759Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231224_231454__31100.090.62690[332, 477]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_231454__311.json50.0missing{\n "num_gpu": 99\n}missing
1760Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231224_231535__88000.040.21750[332, 263]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_231535__880.json25.0missing{\n "num_gpu": 99\n}missing
1761Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_212949__37650.074.54872[332, 366]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212949__376.json100.0missing{\n "num_gpu": 99\n}missing
1762Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231213_233540__54800.020.58670[11, 549]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233540__548.json25.0missingmissingmissing
1763Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231224_232147__40550.053.57222[426, 346]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_232147__405.json100.0missing{\n "num_gpu": 99\n}missing
1764Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231224_232252__49400.064.97990[426, 433]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_232252__494.json25.0missing{\n "num_gpu": 99\n}missing
1765Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231226_213231__40350.045.08212[426, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_213231__403.json100.0missing{\n "num_gpu": 99\n}missing
1766Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse520231213_233520__72300.025.25150[412, 575]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231213_233520__723.json0.0missingmissingmissing
1767Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231224_232005__48400.025.97330[423, 134]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_232005__484.json50.0missing{\n "num_gpu": 99\n}missing
1768Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231224_232053__99100.047.97160[423, 305]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231224_232053__991.json25.0missing{\n "num_gpu": 99\n}missing
1769Apple-MacBook-Pro-M1audi_filterphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_213146__86650.037.64512[423, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_213146__866.json100.0missing{\n "num_gpu": 99\n}missing
1770Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_212804__82600.015.44240[95, 451]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_212804__826.json0.0missingmissingmissing
1771Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_212826__80200.021.99070[1, 647]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_212826__802.json0.0missingmissingmissing
1772Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_212845__22400.019.05760[1, 568]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_212845__224.json0.0missingmissingmissing
1773Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231224_233457__84500.011.16930[116, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231224_233457__845.json0.0missing{\n "num_gpu": 99\n}missing
1774Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231224_233513__62500.015.16680[116, 249]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231224_233513__625.json0.0missing{\n "num_gpu": 99\n}missing
1775Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_212733__75200.015.72990[1, 476]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_212733__752.json0.0missingmissingmissing
1776Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_212748__11400.015.02610[1, 456]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_212748__114.json25.0missingmissingmissing
1777Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231224_233432__34600.018.72860[119, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_233432__346.json0.0missing{\n "num_gpu": 99\n}missing
1778Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231224_233446__95900.013.57030[119, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231224_233446__959.json50.0missing{\n "num_gpu": 99\n}missing
1779Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231226_213853__91900.013.27540[119, 216]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_213853__919.json0.0missing{\n "num_gpu": 99\n}missing
1780Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_212648__35600.011.0220[1, 337]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212648__356.json0.0missingmissingmissing
1781Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_212656__37500.08.734310[1, 270]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_212656__375.json0.0missingmissingmissing
1782Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231224_233358__84400.013.73360[160, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233358__844.json50.0missing{\n "num_gpu": 99\n}missing
1783Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231224_233413__35900.015.11580[160, 243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231224_233413__359.json0.0missing{\n "num_gpu": 99\n}missing
1784Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_213839__48700.09.820330[160, 151]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_213839__487.json50.0missing{\n "num_gpu": 99\n}missing
1785Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_212551__20500.09.933040[1, 289]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212551__205.json0.0missingmissingmissing
1786Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_212617__79500.025.81430[1, 703]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_212617__795.json0.0missingmissingmissing
1787Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231224_233326__93600.028.08320[340, 262]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233326__936.json0.0missing{\n "num_gpu": 99\n}missing
1788Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231224_233344__65900.018.84530[340, 276]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231224_233344__659.json0.0missing{\n "num_gpu": 99\n}missing
1789Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_213829__15600.030.69230[340, 327]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_213829__156.json0.0missing{\n "num_gpu": 99\n}missing
1790Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_213040__60900.028.0871[1, 739]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213040__609.json62.5missingmissingmissing
1791Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_213041__20200.01.40050[1, 41]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_213041__202.json0.0missingmissingmissing
1792Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231224_233607__84600.017.03520[427, 231]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233607__846.json25.0missing{\n "num_gpu": 99\n}missing
1793Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231224_233624__40500.016.26120[427, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231224_233624__405.json0.0missing{\n "num_gpu": 99\n}missing
1794Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231226_213937__21600.024.50570[427, 355]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_213937__216.json25.0missing{\n "num_gpu": 99\n}missing
1795Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_212929__96900.024.75690[1, 660]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212929__969.json50.0missingmissingmissing
1796Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_212953__31400.023.42190[1, 627]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_212953__314.json50.0missingmissingmissing
1797Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_233534__31100.021.00670[425, 297]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233534__311.json50.0missing{\n "num_gpu": 99\n}missing
1798Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231224_233550__15500.016.620[425, 224]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231224_233550__155.json50.0missing{\n "num_gpu": 99\n}missing
1799Apple-MacBook-Pro-M1audi_filtersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231226_213913__90000.020.15650[425, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_213913__900.json0.0missing{\n "num_gpu": 99\n}missing
1800Apple-MacBook-Pro-M1audi_filterstablelm-zephyrAsIs1SHOTfalsefalse520231213_233113__41100.019.27560[95, 555]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__AsIs__1SHOT__20231213_233113__411.json0.0missingmissingmissing
1801Apple-MacBook-Pro-M1audi_filterstablelm-zephyrAsIs1SHOTfalsefalse520231224_230832__22600.05.40510[115, 299]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__AsIs__1SHOT__20231224_230832__226.json0.0missing{\n "num_gpu": 99\n}missing
1802Apple-MacBook-Pro-M1audi_filterstablelm-zephyrAsIs1SHOTfalsefalse520231224_230837__79100.04.684430[115, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__AsIs__1SHOT__20231224_230837__791.json0.0missing{\n "num_gpu": 99\n}missing
1803Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTfalsefalse520231213_233053__74800.013.5930[112, 391]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231213_233053__748.json0.0missingmissingmissing
1804Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTfalsefalse520231224_230823__90400.05.815420[118, 321]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_230823__904.json0.0missing{\n "num_gpu": 99\n}missing
1805Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTtruetrue520231224_230826__95200.03.782880[118, 207]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231224_230826__952.json50.0missing{\n "num_gpu": 99\n}missing
1806Apple-MacBook-Pro-M1audi_filterstablelm-zephyrInJulia1SHOTtruetrue520231226_212629__16900.03.31260[118, 180]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_212629__169.json50.0missing{\n "num_gpu": 99\n}missing
1807Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231213_233040__79100.010.84570[141, 300]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231213_233040__791.json0.0missingmissingmissing
1808Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231224_230812__43400.02.778180[155, 142]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_230812__434.json0.0missing{\n "num_gpu": 99\n}missing
1809Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231224_230817__10800.04.432170[155, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231224_230817__108.json0.0missing{\n "num_gpu": 99\n}missing
1810Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231226_212626__92500.02.257920[155, 112]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_212626__925.json0.0missing{\n "num_gpu": 99\n}missing
1811Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231213_233029__96000.021.25060[311, 519]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233029__960.json0.0missingmissingmissing
1812Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231224_230802__78100.08.819380[321, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230802__781.json0.0missing{\n "num_gpu": 99\n}missing
1813Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231224_230810__71700.08.060670[321, 385]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231224_230810__717.json0.0missing{\n "num_gpu": 99\n}missing
1814Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_212624__32900.018.55750[321, 766]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212624__329.json0.0missing{\n "num_gpu": 99\n}missing
1815Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231213_233201__83300.025.66710[11, 674]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233201__833.json0.0missingmissingmissing
1816Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231224_230900__54900.08.136010[405, 367]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230900__549.json50.0missing{\n "num_gpu": 99\n}missing
1817Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231224_230912__22500.011.32150[405, 522]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231224_230912__225.json0.0missing{\n "num_gpu": 99\n}missing
1818Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_212643__40900.06.622030[405, 290]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212643__409.json50.0missing{\n "num_gpu": 99\n}missing
1819Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231213_233134__86100.021.86030[412, 490]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231213_233134__861.json50.0missingmissingmissing
1820Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231224_230844__93300.07.248210[403, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_230844__933.json50.0missing{\n "num_gpu": 99\n}missing
1821Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231224_230852__41400.07.950470[403, 358]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231224_230852__414.json0.0missing{\n "num_gpu": 99\n}missing
1822Apple-MacBook-Pro-M1audi_filterstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231226_212637__88500.07.487840[403, 335]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_212637__885.json25.0missing{\n "num_gpu": 99\n}missing
1823Apple-MacBook-Pro-M1audi_filterstarling-lm:latestAsIs1SHOTfalsefalse520231213_232151__97800.09.675410[95, 282]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__AsIs__1SHOT__20231213_232151__978.json0.0missingmissingmissing
1824Apple-MacBook-Pro-M1audi_filterstarling-lm:latestAsIs1SHOTfalsefalse520231224_224723__22900.08.922120[116, 277]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__AsIs__1SHOT__20231224_224723__229.json0.0missing{\n "num_gpu": 99\n}missing
1825Apple-MacBook-Pro-M1audi_filterstarling-lm:latestAsIs1SHOTfalsefalse520231224_224732__19900.08.950060[116, 279]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__AsIs__1SHOT__20231224_224732__199.json0.0missing{\n "num_gpu": 99\n}missing
1826Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTfalsefalse520231213_232142__37100.017.24030[112, 494]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_232142__371.json0.0missingmissingmissing
1827Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruetrue520231224_224702__57000.010.34470[119, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_224702__570.json50.0missing{\n "num_gpu": 99\n}missing
1828Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruetrue520231224_224713__99600.011.19540[119, 351]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_224713__996.json50.0missing{\n "num_gpu": 99\n}missing
1829Apple-MacBook-Pro-M1audi_filterstarling-lm:latestInJulia1SHOTtruetrue520231226_211838__35900.06.862970[119, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_211838__359.json50.0missing{\n "num_gpu": 99\n}missing
1830Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231213_232124__24800.017.42090[141, 487]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_232124__248.json0.0missingmissingmissing
1831Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_224643__37000.011.91720[160, 369]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_224643__370.json50.0missing{\n "num_gpu": 99\n}missing
1832Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_224651__37200.07.368290[160, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_224651__372.json50.0missing{\n "num_gpu": 99\n}missing
1833Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_211831__29700.021.84220[160, 681]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_211831__297.json50.0missing{\n "num_gpu": 99\n}missing
1834Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231213_232107__91400.020.83240[311, 509]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232107__914.json0.0missingmissingmissing
1835Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231224_224617__47600.030.78150[340, 735]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224617__476.json0.0missing{\n "num_gpu": 99\n}missing
1836Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231224_224631__18700.014.07190[340, 400]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224631__187.json0.0missing{\n "num_gpu": 99\n}missing
1837Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231226_211809__92300.022.27160[340, 495]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_211809__923.json0.0missing{\n "num_gpu": 99\n}missing
1838Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231213_232239__13000.020.37450[11, 544]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232239__130.json50.0missingmissingmissing
1839Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231224_224817__59400.016.75720[427, 463]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224817__594.json0.0missing{\n "num_gpu": 99\n}missing
1840Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231224_224838__37700.020.82250[427, 587]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_224838__377.json50.0missing{\n "num_gpu": 99\n}missing
1841Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_211911__65100.013.58880[427, 368]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_211911__651.json50.0missing{\n "num_gpu": 99\n}missing
1842Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231213_232219__38500.027.75080[412, 637]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_232219__385.json25.0missingmissingmissing
1843Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_224745__58700.013.45770[425, 363]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_224745__587.json50.0missing{\n "num_gpu": 99\n}missing
1844Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_224800__82400.014.56160[425, 397]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_224800__824.json50.0missing{\n "num_gpu": 99\n}missing
1845Apple-MacBook-Pro-M1audi_filterstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231226_211858__69200.019.4810[425, 548]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_211858__692.json0.0missing{\n "num_gpu": 99\n}missing
1846Apple-MacBook-Pro-M1audi_filteryi:34b-chatAsIs1SHOTfalsefalse520231213_232345__75600.018.61510[95, 537]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__AsIs__1SHOT__20231213_232345__756.json0.0missingmissingmissing
1847Apple-MacBook-Pro-M1audi_filteryi:34b-chatAsIs1SHOTfalsefalse520231224_225336__76300.035.06490[113, 254]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__AsIs__1SHOT__20231224_225336__763.json0.0missing{\n "num_gpu": 99\n}missing
1848Apple-MacBook-Pro-M1audi_filteryi:34b-chatAsIs1SHOTfalsefalse520231224_225416__11600.039.69680[113, 289]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__AsIs__1SHOT__20231224_225416__116.json0.0missing{\n "num_gpu": 99\n}missing
1849Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruefalse520231213_232326__50400.020.51420[112, 584]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_232326__504.json25.0missingmissingmissing
1850Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruetrue520231224_225221__79300.037.58880[116, 273]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_225221__793.json50.0missing{\n "num_gpu": 99\n}missing
1851Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruefalse520231224_225301__99600.039.64530[116, 289]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_225301__996.json25.0missing{\n "num_gpu": 99\n}missing
1852Apple-MacBook-Pro-M1audi_filteryi:34b-chatInJulia1SHOTtruefalse520231226_212155__97300.049.94780[116, 368]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_212155__973.json25.0missing{\n "num_gpu": 99\n}missing
1853Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231213_232305__26300.010.22190[141, 282]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_232305__263.json0.0missingmissingmissing
1854Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231224_225120__52100.033.82581[155, 238]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_225120__521.json62.5missing{\n "num_gpu": 99\n}missing
1855Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231224_225143__50100.023.30890[155, 157]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_225143__501.json0.0missing{\n "num_gpu": 99\n}missing
1856Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_212105__91000.030.0230[155, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_212105__910.json50.0missing{\n "num_gpu": 99\n}missing
1857Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231213_232255__45800.015.71840[311, 373]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_232255__458.json0.0missingmissingmissing
1858Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231224_224932__14100.054.12860[343, 164]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_224932__141.json25.0missing{\n "num_gpu": 99\n}missing
1859Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231224_225045__45100.072.78190[343, 490]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_225045__451.json0.0missing{\n "num_gpu": 99\n}missing
1860Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231226_212035__51400.082.94530[343, 404]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_212035__514.json25.0missing{\n "num_gpu": 99\n}missing
1861Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231213_232434__58500.017.37040[11, 468]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_232434__585.json25.0missingmissingmissing
1862Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231224_225700__94500.052.24430[429, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_225700__945.json25.0missing{\n "num_gpu": 99\n}missing
1863Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231224_225826__33100.085.50140[429, 562]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231224_225826__331.json50.0missing{\n "num_gpu": 99\n}missing
1864Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231226_212329__46100.041.37520[429, 243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_212329__461.json25.0missing{\n "num_gpu": 99\n}missing
1865Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTfalsefalse520231213_232416__61800.031.8150[412, 733]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_232416__618.json0.0missingmissingmissing
1866Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_225518__57400.062.53520[427, 397]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_225518__574.json25.0missing{\n "num_gpu": 99\n}missing
1867Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_225608__38100.049.38160[427, 301]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_225608__381.json25.0missing{\n "num_gpu": 99\n}missing
1868Apple-MacBook-Pro-M1audi_filteryi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_212247__76900.052.01330[427, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/audi_filter/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_212247__769.json50.0missing{\n "num_gpu": 99\n}missing
1869Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructAsIs1SHOTfalsefalse520231213_234216__25800.013.94010[44, 421]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231213_234216__258.json0.0missingmissingmissing
1870Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructAsIs1SHOTfalsefalse520231225_000158__60900.02.669020[66, 36]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_000158__609.json0.0missing{\n "num_gpu": 99\n}missing
1871Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructAsIs1SHOTfalsefalse520231225_000202__15800.04.580320[66, 73]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_000202__158.json0.0missing{\n "num_gpu": 99\n}missing
1872Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTfalsefalse520231213_234202__29200.014.48850[60, 435]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231213_234202__292.json0.0missingmissingmissing
1873Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTtruetrue520231225_000132__11500.013.94090[68, 251]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_000132__115.json50.0missing{\n "num_gpu": 99\n}missing
1874Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTtruetrue520231225_000155__63800.023.00820[68, 420]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_000155__638.json50.0missing{\n "num_gpu": 99\n}missing
1875Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructInJulia1SHOTtruetrue520231226_220105__49600.012.9260[68, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_220105__496.json50.0missing{\n "num_gpu": 99\n}missing
1876Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231213_234148__62100.06.819690[90, 196]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231213_234148__621.json50.0missingmissingmissing
1877Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_000114__85300.07.303390[107, 120]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_000114__853.json50.0missing{\n "num_gpu": 99\n}missing
1878Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_000118__48800.03.536730[107, 48]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_000118__488.json50.0missing{\n "num_gpu": 99\n}missing
1879Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_220052__88200.03.356660[107, 45]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_220052__882.json50.0missing{\n "num_gpu": 99\n}missing
1880Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231213_234141__15900.014.35330[201, 379]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234141__159.json50.0missingmissingmissing
1881Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_000058__60600.014.78810[219, 57]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000058__606.json0.0missing{\n "num_gpu": 99\n}missing
1882Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_000107__34000.08.90920[219, 134]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000107__340.json0.0missing{\n "num_gpu": 99\n}missing
1883Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_220048__68800.012.87220[219, 33]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220048__688.json0.0missing{\n "num_gpu": 99\n}missing
1884Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231213_234257__42200.017.8140[11, 487]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234257__422.json25.0missingmissingmissing
1885Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231225_000257__38100.08.878210[372, 107]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000257__381.json0.0missing{\n "num_gpu": 99\n}missing
1886Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_000318__39600.021.02020[372, 325]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000318__396.json50.0missing{\n "num_gpu": 99\n}missing
1887Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_220138__48500.011.79430[372, 161]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220138__485.json50.0missing{\n "num_gpu": 99\n}missing
1888Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231213_234239__74900.022.59050[361, 531]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231213_234239__749.json25.0missingmissingmissing
1889Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231225_000229__76600.026.16960[369, 416]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_000229__766.json25.0missing{\n "num_gpu": 99\n}missing
1890Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_000248__17700.019.11940[369, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_000248__177.json50.0missing{\n "num_gpu": 99\n}missing
1891Apple-MacBook-Pro-M1count_model_rowscodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231226_220126__37700.021.45020[369, 335]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_220126__377.json25.0missing{\n "num_gpu": 99\n}missing
1892NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MInJulia1SHOTtruefalse520240131_221726__45700.05.084680[0, 387]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221726__457.json25.0missing{\n "num_gpu": 99\n}missing
1893NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221731__30910.04.899621[0, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221731__309.json67.5missing{\n "num_gpu": 99\n}missing
1894NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221735__42500.04.086350[0, 312]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221735__425.json50.0missing{\n "num_gpu": 99\n}missing
1895NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221740__38900.04.44680[0, 339]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221740__389.json50.0missing{\n "num_gpu": 99\n}missing
1896NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MInJulia1SHOTtruefalse520240131_221744__10600.04.014510[0, 306]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221744__106.json25.0missing{\n "num_gpu": 99\n}missing
1897NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_221657__21110.01.120242[0, 83]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221657__211.json80.0missing{\n "num_gpu": 99\n}missing
1898NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_221658__35010.00.6066572[0, 45]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221658__350.json80.0missing{\n "num_gpu": 99\n}missing
1899NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_221658__53410.00.4777532[0, 36]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221658__534.json80.0missing{\n "num_gpu": 99\n}missing
1900NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_221659__79410.00.473692[0, 36]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221659__794.json80.0missing{\n "num_gpu": 99\n}missing
1901NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240131_221701__76700.01.943160[0, 148]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221701__767.json25.0missing{\n "num_gpu": 99\n}missing
1902NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221639__90300.00.6243760[0, 47]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221639__903.json0.0missing{\n "num_gpu": 99\n}missing
1903NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_221644__65000.05.209530[0, 383]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221644__650.json25.0missing{\n "num_gpu": 99\n}missing
1904NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221645__58400.00.8046750[0, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221645__584.json0.0missing{\n "num_gpu": 99\n}missing
1905NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_221648__90910.03.017292[0, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221648__909.json80.0missing{\n "num_gpu": 99\n}missing
1906NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_221649__49400.01.216260[0, 91]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221649__494.json50.0missing{\n "num_gpu": 99\n}missing
1907NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240131_221856__97000.05.336620[0, 396]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221856__970.json25.0missing{\n "num_gpu": 99\n}missing
1908NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_221901__44700.04.752790[0, 353]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221901__447.json50.0missing{\n "num_gpu": 99\n}missing
1909NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_221905__39600.04.161290[0, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221905__396.json50.0missing{\n "num_gpu": 99\n}missing
1910NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_221908__66710.02.498432[0, 187]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221908__667.json80.0missing{\n "num_gpu": 99\n}missing
1911NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_221913__26300.05.11680[0, 379]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221913__263.json0.0missing{\n "num_gpu": 99\n}missing
1912NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_221811__69200.010.59362[0, 769]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_221811__692.json75.0missing{\n "num_gpu": 99\n}missing
1913NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_221817__54100.05.830450[0, 429]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_221817__541.json50.0missing{\n "num_gpu": 99\n}missing
1914NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_221824__42400.06.435670[0, 475]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_221824__424.json50.0missing{\n "num_gpu": 99\n}missing
1915NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_221825__23800.00.5997220[0, 45]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_221825__238.json50.0missing{\n "num_gpu": 99\n}missing
1916NVIDIA-RTX-4090-4xcount_model_rowscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_221828__95300.03.731170[0, 276]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_221828__953.json50.0missing{\n "num_gpu": 99\n}missing
1917Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonAsIs1SHOTfalsefalse520231213_234402__40100.018.43320[44, 548]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__AsIs__1SHOT__20231213_234402__401.json0.0missingmissingmissing
1918Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonAsIs1SHOTfalsefalse520231225_000452__89700.08.468970[39, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_000452__897.json0.0missing{\n "num_gpu": 99\n}missing
1919Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonAsIs1SHOTfalsefalse520231225_000459__36900.07.109810[39, 127]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_000459__369.json0.0missing{\n "num_gpu": 99\n}missing
1920Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonInJulia1SHOTfalsefalse520231213_234344__98400.013.68660[60, 412]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__InJulia__1SHOT__20231213_234344__984.json0.0missingmissingmissing
1921Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonInJulia1SHOTfalsefalse520231225_000411__22600.029.64180[42, 546]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_000411__226.json0.0missing{\n "num_gpu": 99\n}missing
1922Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonInJulia1SHOTfalsefalse520231225_000443__30000.031.87640[42, 586]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_000443__300.json0.0missing{\n "num_gpu": 99\n}missing
1923Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231213_234330__81700.015.9080[90, 464]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231213_234330__817.json50.0missingmissingmissing
1924Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_000336__69200.04.160030[44, 70]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_000336__692.json0.0missing{\n "num_gpu": 99\n}missing
1925Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_000342__55500.05.931730[44, 104]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_000342__555.json0.0missing{\n "num_gpu": 99\n}missing
1926Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231213_234314__20700.017.4420[201, 464]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234314__207.json50.0missingmissingmissing
1927Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_000331__81900.00.8772730[94, 1]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000331__819.json0.0missing{\n "num_gpu": 99\n}missing
1928Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_000331__99100.012.57770[94, 30]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000331__991.json0.0missing{\n "num_gpu": 99\n}missing
1929Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231213_234443__68510.019.50671[11, 530]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234443__685.json67.5missingmissingmissing
1930Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_000512__61700.02.311920[61, 34]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000512__617.json0.0missing{\n "num_gpu": 99\n}missing
1931Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_000515__59100.02.84280[61, 44]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000515__591.json0.0missing{\n "num_gpu": 99\n}missing
1932Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231213_234424__54900.021.33980[361, 500]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231213_234424__549.json50.0missingmissingmissing
1933Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_000503__70600.04.327420[58, 73]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_000503__706.json0.0missing{\n "num_gpu": 99\n}missing
1934Apple-MacBook-Pro-M1count_model_rowscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_000510__52600.06.564860[58, 116]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_000510__526.json0.0missing{\n "num_gpu": 99\n}missing
1935NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_222417__69200.08.866680[0, 318]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_222417__692.json50.0missing{\n "num_gpu": 99\n}missing
1936NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_222423__30000.05.825230[0, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_222423__300.json50.0missing{\n "num_gpu": 99\n}missing
1937NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_222430__52000.07.672420[0, 275]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_222430__520.json50.0missing{\n "num_gpu": 99\n}missing
1938NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_222440__94200.09.914810[0, 355]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_222440__942.json50.0missing{\n "num_gpu": 99\n}missing
1939NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_222445__11000.04.95880[0, 178]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_222445__110.json50.0missing{\n "num_gpu": 99\n}missing
1940NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_222246__37900.05.997640[0, 215]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_222246__379.json50.0missing{\n "num_gpu": 99\n}missing
1941NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_222250__81000.04.232440[0, 152]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_222250__810.json50.0missing{\n "num_gpu": 99\n}missing
1942NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_222301__48000.010.46170[0, 374]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_222301__480.json50.0missing{\n "num_gpu": 99\n}missing
1943NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_222311__50900.010.62990[0, 380]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_222311__509.json50.0missing{\n "num_gpu": 99\n}missing
1944NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_222318__28000.06.800820[0, 243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_222318__280.json0.0missing{\n "num_gpu": 99\n}missing
1945NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_222151__28000.06.948980[0, 249]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_222151__280.json25.0missing{\n "num_gpu": 99\n}missing
1946NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_222159__32000.08.547140[0, 306]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_222159__320.json50.0missing{\n "num_gpu": 99\n}missing
1947NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_222205__70900.06.17630[0, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_222205__709.json0.0missing{\n "num_gpu": 99\n}missing
1948NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_222208__65500.02.418690[0, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_222208__655.json25.0missing{\n "num_gpu": 99\n}missing
1949NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_222214__48600.06.45970[0, 231]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_222214__486.json25.0missing{\n "num_gpu": 99\n}missing
1950NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_222543__86000.00.1163730[0, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222543__860.json0.0missing{\n "num_gpu": 99\n}missing
1951NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_222544__74200.00.1166150[0, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222544__742.json0.0missing{\n "num_gpu": 99\n}missing
1952NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_222553__42300.09.595580[0, 338]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222553__423.json0.0missing{\n "num_gpu": 99\n}missing
1953NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_222608__59100.015.240[0, 539]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222608__591.json50.0missing{\n "num_gpu": 99\n}missing
1954NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_222609__70200.00.122610[0, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222609__702.json0.0missing{\n "num_gpu": 99\n}missing
1955NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_222527__14210.05.718642[0, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222527__142.json80.0missing{\n "num_gpu": 99\n}missing
1956NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_222527__39800.00.1438030[0, 5]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222527__398.json0.0missing{\n "num_gpu": 99\n}missing
1957NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_222527__41100.00.1437870[0, 5]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222527__411.json0.0missing{\n "num_gpu": 99\n}missing
1958NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_222527__41600.00.1439080[0, 5]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222527__416.json0.0missing{\n "num_gpu": 99\n}missing
1959NVIDIA-RTX-4090-4xcount_model_rowscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_222527__52600.00.144080[0, 5]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222527__526.json0.0missing{\n "num_gpu": 99\n}missing
1960NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_221318__78500.05.431220[0, 134]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_221318__785.json50.0missing{\n "num_gpu": 99\n}missing
1961NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_221321__96000.02.422920[0, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_221321__960.json0.0missing{\n "num_gpu": 99\n}missing
1962NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_221326__98300.05.458110[0, 135]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_221326__983.json50.0missing{\n "num_gpu": 99\n}missing
1963NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_221335__72400.08.223640[0, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_221335__724.json0.0missing{\n "num_gpu": 99\n}missing
1964NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_221343__56500.08.186070[0, 202]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_221343__565.json0.0missing{\n "num_gpu": 99\n}missing
1965NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240131_221204__16900.08.812120[0, 217]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_221204__169.json50.0missing{\n "num_gpu": 99\n}missing
1966NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_221213__52400.09.504090[0, 234]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_221213__524.json0.0missing{\n "num_gpu": 99\n}missing
1967NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_221218__23700.04.257570[0, 105]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_221218__237.json0.0missing{\n "num_gpu": 99\n}missing
1968NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240131_221223__65900.05.594172[0, 138]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_221223__659.json75.0missing{\n "num_gpu": 99\n}missing
1969NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_221237__12600.013.41070[0, 330]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_221237__126.json0.0missing{\n "num_gpu": 99\n}missing
1970NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_221058__25800.06.348170[0, 155]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221058__258.json0.0missing{\n "num_gpu": 99\n}missing
1971NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_221103__20000.05.102970[0, 125]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221103__200.json50.0missing{\n "num_gpu": 99\n}missing
1972NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_221111__89300.08.432440[0, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221111__893.json0.0missing{\n "num_gpu": 99\n}missing
1973NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_221116__12700.05.20280[0, 128]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221116__127.json0.0missing{\n "num_gpu": 99\n}missing
1974NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_221124__37900.07.893942[0, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221124__379.json75.0missing{\n "num_gpu": 99\n}missing
1975NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_221555__56800.08.640470[0, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221555__568.json50.0missing{\n "num_gpu": 99\n}missing
1976NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_221600__22000.05.726650[0, 140]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221600__220.json0.0missing{\n "num_gpu": 99\n}missing
1977NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_221603__40300.02.944690[0, 72]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221603__403.json50.0missing{\n "num_gpu": 99\n}missing
1978NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_221613__50400.09.789710[0, 238]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221613__504.json0.0missing{\n "num_gpu": 99\n}missing
1979NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_221624__72800.010.78980[0, 262]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_221624__728.json50.0missing{\n "num_gpu": 99\n}missing
1980NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_221432__23300.04.768840[0, 116]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_221432__233.json50.0missing{\n "num_gpu": 99\n}missing
1981NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_221442__61300.09.446740[0, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_221442__613.json50.0missing{\n "num_gpu": 99\n}missing
1982NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_221452__33200.010.72180[0, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_221452__332.json50.0missing{\n "num_gpu": 99\n}missing
1983NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240131_221459__21100.06.927230[0, 169]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_221459__211.json0.0missing{\n "num_gpu": 99\n}missing
1984NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_221508__57400.08.540450[0, 208]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_221508__574.json50.0missing{\n "num_gpu": 99\n}missing
1985NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_220435__30100.012.18540[0, 228]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_220435__301.json50.0missing{\n "num_gpu": 99\n}missing
1986NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_220455__21000.019.93220[0, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_220455__210.json50.0missing{\n "num_gpu": 99\n}missing
1987NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MInJulia1SHOTtruefalse520240131_220507__42700.012.40910[0, 232]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_220507__427.json25.0missing{\n "num_gpu": 99\n}missing
1988NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_220522__10400.014.83680[0, 278]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_220522__104.json0.0missing{\n "num_gpu": 99\n}missing
1989NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MInJulia1SHOTtruefalse520240131_220532__84400.010.32650[0, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_220532__844.json25.0missing{\n "num_gpu": 99\n}missing
1990NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_220215__42200.012.43640[0, 232]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_220215__422.json0.0missing{\n "num_gpu": 99\n}missing
1991NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_220241__38100.025.83390[0, 480]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_220241__381.json0.0missing{\n "num_gpu": 99\n}missing
1992NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_220253__84300.012.34020[0, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_220253__843.json0.0missing{\n "num_gpu": 99\n}missing
1993NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_220305__11000.011.77860[0, 220]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_220305__110.json50.0missing{\n "num_gpu": 99\n}missing
1994NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_220316__89600.010.39320[0, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_220316__896.json0.0missing{\n "num_gpu": 99\n}missing
1995NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_220032__72300.012.22890[0, 227]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_220032__723.json0.0missing{\n "num_gpu": 99\n}missing
1996NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_220046__10300.013.33150[0, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_220046__103.json0.0missing{\n "num_gpu": 99\n}missing
1997NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_220105__78900.019.1780[0, 355]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_220105__789.json0.0missing{\n "num_gpu": 99\n}missing
1998NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_220113__48600.08.290150[0, 154]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_220113__486.json0.0missing{\n "num_gpu": 99\n}missing
1999NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240131_220120__47700.06.917260[0, 129]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_220120__477.json25.0missing{\n "num_gpu": 99\n}missing
2000NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_220856__34500.015.98550[0, 295]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_220856__345.json50.0missing{\n "num_gpu": 99\n}missing
2001NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_220913__44000.016.5640[0, 306]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_220913__440.json50.0missing{\n "num_gpu": 99\n}missing
2002NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_220925__81600.012.22910[0, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_220925__816.json0.0missing{\n "num_gpu": 99\n}missing
2003NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_220935__11200.09.380710[0, 174]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_220935__112.json0.0missing{\n "num_gpu": 99\n}missing
2004NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_220947__61900.012.10340[0, 224]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_220947__619.json0.0missing{\n "num_gpu": 99\n}missing
2005NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_220654__33110.017.00212[0, 315]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_220654__331.json80.0missing{\n "num_gpu": 99\n}missing
2006NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_220705__17400.010.75620[0, 199]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_220705__174.json0.0missing{\n "num_gpu": 99\n}missing
2007NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_220718__80510.013.23792[0, 245]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_220718__805.json80.0missing{\n "num_gpu": 99\n}missing
2008NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_220723__59400.05.20960[0, 96]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_220723__594.json0.0missing{\n "num_gpu": 99\n}missing
2009NVIDIA-RTX-4090-4xcount_model_rowscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_220732__75700.08.658780[0, 161]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_220732__757.json0.0missing{\n "num_gpu": 99\n}missing
2010NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221939__86000.01.416350[0, 170]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221939__860.json50.0missing{\n "num_gpu": 99\n}missing
2011NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MInJulia1SHOTtruefalse520240131_221942__48900.02.382620[0, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221942__489.json25.0missing{\n "num_gpu": 99\n}missing
2012NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221944__32900.02.004350[0, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221944__329.json50.0missing{\n "num_gpu": 99\n}missing
2013NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221945__48200.01.289030[0, 158]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221945__482.json50.0missing{\n "num_gpu": 99\n}missing
2014NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_221947__23700.02.254410[0, 274]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_221947__237.json50.0missing{\n "num_gpu": 99\n}missing
2015NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_221926__26100.00.2330450[0, 28]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221926__261.json0.0missing{\n "num_gpu": 99\n}missing
2016NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_221926__59600.00.2321290[0, 28]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221926__596.json0.0missing{\n "num_gpu": 99\n}missing
2017NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_221926__81900.00.2320430[0, 28]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221926__819.json0.0missing{\n "num_gpu": 99\n}missing
2018NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_221927__17700.00.2336770[0, 28]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221927__177.json0.0missing{\n "num_gpu": 99\n}missing
2019NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_221927__99700.00.2993810[0, 36]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_221927__997.json0.0missing{\n "num_gpu": 99\n}missing
2020NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221921__12300.00.7229510[0, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221921__123.json0.0missing{\n "num_gpu": 99\n}missing
2021NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221921__22500.00.5138520[0, 62]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221921__225.json0.0missing{\n "num_gpu": 99\n}missing
2022NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221922__42100.00.7208890[0, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221922__421.json0.0missing{\n "num_gpu": 99\n}missing
2023NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221923__43500.00.9348960[0, 113]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221923__435.json0.0missing{\n "num_gpu": 99\n}missing
2024NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_221924__53300.00.6627380[0, 80]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_221924__533.json0.0missing{\n "num_gpu": 99\n}missing
2025NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_222038__84200.02.748360[0, 314]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222038__842.json50.0missing{\n "num_gpu": 99\n}missing
2026NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_222040__66010.02.357451[0, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222040__660.json67.5missing{\n "num_gpu": 99\n}missing
2027NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_222042__11200.01.643160[0, 189]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222042__112.json50.0missing{\n "num_gpu": 99\n}missing
2028NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_222044__98800.01.904120[0, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222044__988.json50.0missing{\n "num_gpu": 99\n}missing
2029NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_222048__17210.04.036172[0, 459]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_222048__172.json80.0missing{\n "num_gpu": 99\n}missing
2030NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_222003__90410.01.784492[0, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222003__904.json80.0missing{\n "num_gpu": 99\n}missing
2031NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_222005__80200.02.466760[0, 292]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222005__802.json50.0missing{\n "num_gpu": 99\n}missing
2032NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_222008__30500.02.579120[0, 307]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222008__305.json50.0missing{\n "num_gpu": 99\n}missing
2033NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_222011__78800.02.545681[0, 304]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222011__788.json62.5missing{\n "num_gpu": 99\n}missing
2034NVIDIA-RTX-4090-4xcount_model_rowscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_222014__56400.03.229720[0, 383]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_222014__564.json50.0missing{\n "num_gpu": 99\n}missing
2035Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200214__34710.0002881.503122[54, 174]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200214__347.json80.0missingmissingmissing
2036Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200215__53010.00021751.089272[54, 127]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200215__530.json80.0missingmissingmissing
2037Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200217__79400.0003061.356560[54, 186]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200217__794.json50.0missingmissingmissing
2038Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200218__45510.0002761.482632[54, 166]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200218__455.json80.0missingmissingmissing
2039Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200220__37000.00022351.241750[54, 131]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200220__370.json50.0missingmissingmissing
2040Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200210__69919.55e-50.6633822[89, 34]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200210__699.json80.0missingmissingmissing
2041Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200211__48519.7e-50.5139762[89, 35]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200211__485.json80.0missingmissingmissing
2042Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200212__41219.85e-50.4553962[89, 36]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200212__412.json80.0missingmissingmissing
2043Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200212__81819.25e-50.5359982[89, 32]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200212__818.json80.0missingmissingmissing
2044Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruefalse520240201_200213__85100.00010750.5743090[89, 42]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200213__851.json25.0missingmissingmissing
2045Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200206__87450.00020350.7029442[179, 76]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200206__874.json100.0missingmissingmissing
2046Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200207__87210.0001960.9192042[179, 71]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200207__872.json80.0missingmissingmissing
2047Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200208__53310.0001960.8839942[179, 71]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200208__533.json80.0missingmissingmissing
2048Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200209__33410.0001930.8931832[179, 69]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200209__334.json80.0missingmissingmissing
2049Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200210__22810.00019150.7131062[179, 68]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200210__228.json80.0missingmissingmissing
2050Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200225__34310.00034051.204192[312, 123]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200225__343.json80.0missingmissingmissing
2051Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200226__49150.0002250.6590012[312, 46]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200226__491.json100.0missingmissingmissing
2052Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200227__26200.00026850.7728670[312, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200227__262.json0.0missingmissingmissing
2053Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200228__20010.00037351.335812[312, 145]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200228__200.json80.0missingmissingmissing
2054Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200229__65610.00022350.5741722[312, 45]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200229__656.json80.0missingmissingmissing
2055Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200221__79010.000220.7569912[311, 43]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200221__790.json80.0missingmissingmissing
2056Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200221__80810.000220.5707662[311, 43]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200221__808.json80.0missingmissingmissing
2057Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200222__84310.0002140.7505362[311, 39]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200222__843.json80.0missingmissingmissing
2058Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200223__13510.0003011.037292[311, 97]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200223__135.json80.0missingmissingmissing
2059Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200224__59510.0003160.9460772[311, 107]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200224__595.json80.0missingmissingmissing
2060Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewInJulia1SHOTtruetrue520240201_072834__98410.0171640.00432[54, 554]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_072834__984.json80.0missingmissingmissing
2061Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewInJulia1SHOTtruetrue520240201_072901__73750.0139826.43062[54, 448]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_072901__737.json100.0missingmissingmissing
2062Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewInJulia1SHOTtruetrue520240201_072932__23550.0137731.1432[54, 441]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_072932__235.json100.0missingmissingmissing
2063Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewInJulia1SHOTtruetrue520240201_073001__60050.0132929.10292[54, 425]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_073001__600.json100.0missingmissingmissing
2064Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewInJulia1SHOTtruetrue520240201_073030__48850.0122129.00312[54, 389]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_073030__488.json100.0missingmissingmissing
2065Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_072451__22950.002063.582152[89, 39]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_072451__229.json100.0missingmissingmissing
2066Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_072454__94450.002183.401212[89, 43]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_072454__944.json100.0missingmissingmissing
2067Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_072459__75850.002244.082672[89, 45]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_072459__758.json100.0missingmissingmissing
2068Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_072502__88250.002063.489792[89, 39]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_072502__882.json100.0missingmissingmissing
2069Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_072506__55750.002453.768872[89, 52]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_072506__557.json100.0missingmissingmissing
2070Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_072323__11050.0099821.21412[179, 273]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_072323__110.json100.0missingmissingmissing
2071Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_072332__87150.005518.900892[179, 124]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_072332__871.json100.0missingmissingmissing
2072Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_072345__64950.0050912.36272[179, 110]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_072345__649.json100.0missingmissingmissing
2073Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_072406__50150.0113320.83322[179, 318]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_072406__501.json100.0missingmissingmissing
2074Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_072431__56250.0111825.0452[179, 313]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_072431__562.json100.0missingmissingmissing
2075Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_074310__47250.0222652.71212[312, 638]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_074310__472.json100.0missingmissingmissing
2076Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_074341__42550.0147930.59342[312, 389]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_074341__425.json100.0missingmissingmissing
2077Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_074414__59950.0164433.21382[312, 444]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_074414__599.json100.0missingmissingmissing
2078Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_074453__36650.0183339.29952[312, 507]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_074453__366.json100.0missingmissingmissing
2079Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_074523__17750.0160529.46772[312, 431]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_074523__177.json100.0missingmissingmissing
2080Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_073645__87150.0192544.16662[311, 538]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_073645__871.json100.0missingmissingmissing
2081Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_073721__23750.0179635.63642[311, 495]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_073721__237.json100.0missingmissingmissing
2082Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_073752__21850.0122930.93522[311, 306]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_073752__218.json100.0missingmissingmissing
2083Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_073838__79010.0221946.37232[311, 636]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_073838__790.json80.0missingmissingmissing
2084Apple-MacBook-Pro-M1count_model_rowsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_073914__52650.0189235.34692[311, 527]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/count_model_rows/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_073914__526.json100.0missingmissingmissing
2085Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_214900__13400.011.12170[44, 340]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_214900__134.json0.0missingmissingmissing
2086Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_214914__56700.014.88070[1, 460]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_214914__567.json0.0missingmissingmissing
2087Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_214928__50900.013.71210[1, 426]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_214928__509.json0.0missingmissingmissing
2088Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_002605__23700.049.29770[57, 300]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_002605__237.json0.0missing{\n "num_gpu": 99\n}missing
2089Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_002703__26000.058.37660[57, 356]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_002703__260.json0.0missing{\n "num_gpu": 99\n}missing
2090Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_214833__41200.011.06370[1, 348]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_214833__412.json0.0missingmissingmissing
2091Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_214848__87700.015.14020[1, 467]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_214848__877.json0.0missingmissingmissing
2092Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_002425__45210.060.59362[60, 370]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_002425__452.json80.0missing{\n "num_gpu": 99\n}missing
2093Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_002515__77400.049.58210[60, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_002515__774.json50.0missing{\n "num_gpu": 99\n}missing
2094Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_221124__98650.027.01392[60, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_221124__986.json100.0missing{\n "num_gpu": 99\n}missing
2095Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_214807__67200.07.942080[1, 251]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_214807__672.json50.0missingmissingmissing
2096Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_214811__77100.04.510610[1, 145]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_214811__771.json50.0missingmissingmissing
2097Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_002233__91750.025.70162[101, 143]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_002233__917.json100.0missing{\n "num_gpu": 99\n}missing
2098Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_002324__86800.050.97790[101, 301]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_002324__868.json0.0missing{\n "num_gpu": 99\n}missing
2099Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_221057__85100.022.72130[101, 125]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221057__851.json0.0missing{\n "num_gpu": 99\n}missing
2100Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_214737__54800.013.39370[1, 397]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214737__548.json50.0missingmissingmissing
2101Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_214750__19300.012.81790[1, 381]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_214750__193.json0.0missingmissingmissing
2102Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_002125__53310.064.22272[213, 193]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_002125__533.json80.0missing{\n "num_gpu": 99\n}missing
2103Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_002207__79400.041.31040[213, 223]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_002207__794.json0.0missing{\n "num_gpu": 99\n}missing
2104Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_221034__27750.073.80192[213, 276]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221034__277.json100.0missing{\n "num_gpu": 99\n}missing
2105Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_215104__86100.014.610[1, 411]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215104__861.json50.0missingmissingmissing
2106Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215117__60800.012.81980[1, 363]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215117__608.json25.0missingmissingmissing
2107Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003016__32010.069.30582[389, 361]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003016__320.json80.0missing{\n "num_gpu": 99\n}missing
2108Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_003052__75000.035.72670[389, 159]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003052__750.json25.0missing{\n "num_gpu": 99\n}missing
2109Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231226_221302__55700.033.02220[389, 143]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221302__557.json25.0missing{\n "num_gpu": 99\n}missing
2110Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_215014__12000.021.39640[1, 586]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215014__120.json50.0missingmissingmissing
2111Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_215033__12900.019.25190[1, 532]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215033__129.json0.0missingmissingmissing
2112Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_002808__55350.064.29092[387, 331]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_002808__553.json100.0missing{\n "num_gpu": 99\n}missing
2113Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_002906__81150.057.93432[387, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_002906__811.json100.0missing{\n "num_gpu": 99\n}missing
2114Apple-MacBook-Pro-M1count_model_rowsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_221229__16950.064.43662[387, 333]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221229__169.json100.0missing{\n "num_gpu": 99\n}missing
2115Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231226_221918__15400.09.57990[60, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_221918__154.json25.0missing{\n "num_gpu": 99\n}missing
2116Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_102959__39600.09.226740[60, 357]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_102959__396.json0.0missing{\n "num_gpu": 99\n}missing
2117Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_103007__18500.07.458850[60, 288]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_103007__185.json0.0missing{\n "num_gpu": 99\n}missing
2118Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_103016__93000.08.733250[60, 339]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_103016__930.json0.0missing{\n "num_gpu": 99\n}missing
2119Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_221908__41000.07.927270[97, 301]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_221908__410.json0.0missing{\n "num_gpu": 99\n}missing
2120Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_102939__89200.06.066910[97, 228]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_102939__892.json0.0missing{\n "num_gpu": 99\n}missing
2121Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_102945__55200.06.225730[97, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_102945__552.json50.0missing{\n "num_gpu": 99\n}missing
2122Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse520231227_102950__99300.04.744580[97, 174]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_102950__993.json25.0missing{\n "num_gpu": 99\n}missing
2123Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_221900__72600.08.983860[205, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221900__726.json0.0missing{\n "num_gpu": 99\n}missing
2124Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_102924__10200.07.116260[205, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_102924__102.json0.0missing{\n "num_gpu": 99\n}missing
2125Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_102927__35800.02.960170[205, 91]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_102927__358.json0.0missing{\n "num_gpu": 99\n}missing
2126Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_102933__48400.05.473010[205, 187]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_102933__484.json0.0missing{\n "num_gpu": 99\n}missing
2127Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_221935__96600.08.343770[349, 273]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221935__966.json0.0missing{\n "num_gpu": 99\n}missing
2128Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_103050__51900.08.179750[349, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_103050__519.json25.0missing{\n "num_gpu": 99\n}missing
2129Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_103103__75700.012.06940[349, 406]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_103103__757.json0.0missing{\n "num_gpu": 99\n}missing
2130Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_103112__61200.09.862140[349, 326]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_103112__612.json0.0missing{\n "num_gpu": 99\n}missing
2131Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231226_221927__71400.08.800650[346, 290]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_221927__714.json0.0missing{\n "num_gpu": 99\n}missing
2132Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_103027__93800.011.65350[346, 389]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_103027__938.json0.0missing{\n "num_gpu": 99\n}missing
2133Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_103033__23000.06.067420[346, 188]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_103033__230.json0.0missing{\n "num_gpu": 99\n}missing
2134Apple-MacBook-Pro-M1count_model_rowsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_103042__59210.08.84582[346, 289]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_103042__592.json80.0missing{\n "num_gpu": 99\n}missing
2135Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_104805__55100.02.351440[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104805__551.json25.0missingmissingmissing
2136Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_104808__39300.02.943810[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104808__393.json50.0missingmissingmissing
2137Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_104817__70100.01.900530[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104817__701.json25.0missingmissingmissing
2138Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_104820__96900.02.913440[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_104820__969.json0.0missingmissingmissing
2139Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_113813__41600.01.896020[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_113813__416.json50.0missingmissingmissing
2140Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104733__57800.05.556020[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104733__578.json50.0missingmissingmissing
2141Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_104737__75800.03.463740[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104737__758.json0.0missingmissingmissing
2142Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104739__77600.02.34410[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104739__776.json50.0missingmissingmissing
2143Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104744__28300.04.672930[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104744__283.json50.0missingmissingmissing
2144Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_104747__47300.02.88421[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_104747__473.json62.5missingmissingmissing
2145Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_104640__33500.02.267150[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104640__335.json25.0missingmissingmissing
2146Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_104642__31000.02.489060[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104642__310.json25.0missingmissingmissing
2147Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_104645__36600.02.700590[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104645__366.json50.0missingmissingmissing
2148Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_104652__77400.06.573230[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104652__774.json25.0missingmissingmissing
2149Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_104654__13900.02.298290[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_104654__139.json25.0missingmissingmissing
2150Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_104944__94700.06.51780[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104944__947.json50.0missingmissingmissing
2151Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_104946__72100.02.686740[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104946__721.json25.0missingmissingmissing
2152Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_104949__87100.02.133970[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104949__871.json50.0missingmissingmissing
2153Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_104951__14600.02.453560[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104951__146.json50.0missingmissingmissing
2154Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_104954__27500.03.307720[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_104954__275.json0.0missingmissingmissing
2155Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_104844__88300.01.973790[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104844__883.json0.0missingmissingmissing
2156Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_104850__36000.05.201580[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104850__360.json50.0missingmissingmissing
2157Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_104853__99900.03.404111[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104853__999.json62.5missingmissingmissing
2158Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_104903__51400.09.575220[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104903__514.json0.0missingmissingmissing
2159Apple-MacBook-Pro-M1count_model_rowsgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_104907__21200.04.247610[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_104907__212.json0.0missingmissingmissing
2160Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_215122__20700.09.089640[0, 141]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_215122__207.json25.0missingmissingmissing
2161Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_215141__70700.019.14260[0, 300]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_215141__707.json25.0missingmissingmissing
2162Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_215155__25800.014.06230[0, 217]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_215155__258.json25.0missingmissingmissing
2163Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_215210__45900.015.06670[0, 236]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_215210__459.json25.0missingmissingmissing
2164Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_215227__71300.016.49140[0, 259]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_215227__713.json25.0missingmissingmissing
2165Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_214940__39700.02.069470[0, 30]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_214940__397.json0.0missingmissingmissing
2166Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_214942__73300.01.998250[0, 30]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_214942__733.json0.0missingmissingmissing
2167Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_214944__26800.01.932010[0, 30]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_214944__268.json0.0missingmissingmissing
2168Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_214946__11700.01.951060[0, 30]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_214946__117.json0.0missingmissingmissing
2169Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_214948__73800.01.954690[0, 30]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_214948__738.json0.0missingmissingmissing
2170Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_214801__70100.019.6070[0, 305]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_214801__701.json0.0missingmissingmissing
2171Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_214824__28500.022.04980[0, 345]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_214824__285.json0.0missingmissingmissing
2172Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_214850__42200.026.86130[0, 416]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_214850__422.json0.0missingmissingmissing
2173Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_214908__25100.017.41640[0, 271]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_214908__251.json25.0missingmissingmissing
2174Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_214928__80100.019.90470[0, 311]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_214928__801.json25.0missingmissingmissing
2175Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_215748__59500.019.56150[0, 299]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_215748__595.json50.0missingmissingmissing
2176Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_215818__34500.029.44520[0, 448]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_215818__345.json50.0missingmissingmissing
2177Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse520240223_215841__90500.023.19830[0, 358]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_215841__905.json25.0missingmissingmissing
2178Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240223_215905__62300.024.57520[0, 371]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_215905__623.json0.0missingmissingmissing
2179Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240223_215925__99200.019.56480[0, 297]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_215925__992.json0.0missingmissingmissing
2180Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_215432__34800.020.6290[0, 318]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_215432__348.json0.0missingmissingmissing
2181Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse520240223_215456__41300.024.27970[0, 375]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_215456__413.json25.0missingmissingmissing
2182Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_215518__61200.022.16011[0, 344]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_215518__612.json62.5missingmissingmissing
2183Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_215539__73500.020.93590[0, 322]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_215539__735.json50.0missingmissingmissing
2184Apple-MacBook-Pro-M1count_model_rowsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse520240223_215555__26400.016.16860[0, 250]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_215555__264.json25.0missingmissingmissing
2185Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboAsIs1SHOTfalsefalse520231213_212857__16400.0002163.372190[51, 127]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_212857__164.json0.0missingmissingmissing
2186Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboAsIs1SHOTfalsefalse520231225_184003__70500.0002883.390040[51, 175]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_184003__705.json0.0missingmissingmissing
2187Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboAsIs1SHOTfalsefalse520231225_184005__36500.00017252.155690[51, 98]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_184005__365.json0.0missingmissingmissing
2188Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_190622__36900.04.55240[51, 175]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_190622__369.json0.00.5missing0.5
2189Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboInJulia1SHOTtruetrue520231213_212854__63200.0004115.410370[54, 256]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_212854__632.json50.0missingmissingmissing
2190Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboInJulia1SHOTtruetrue520231225_183955__15200.00038254.006310[54, 237]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_183955__152.json50.0missingmissingmissing
2191Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboInJulia1SHOTtruetrue520231225_184000__65800.000394.728080[54, 242]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_184000__658.json50.0missingmissingmissing
2192Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboInJulia1SHOTtruetrue520231227_191244__58600.0004565.238622[54, 286]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_191244__586.json75.0missingmissingmissing
2193Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboInJulia1SHOTtruetrue520231227_191246__74100.0001832.200280[54, 104]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_191246__741.json50.0missingmissingmissing
2194Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_190618__65150.04.905732[54, 195]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_190618__651.json100.00.5missing0.5
2195Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_212848__15710.00010151.161322[89, 38]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_212848__157.json80.0missingmissingmissing
2196Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_183950__20509.55e-51.139090[89, 34]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_183950__205.json50.0missingmissingmissing
2197Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_183951__18709.25e-50.8296830[89, 32]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_183951__187.json50.0missingmissingmissing
2198Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_191237__92519.85e-51.277292[89, 36]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_191237__925.json80.0missingmissingmissing
2199Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_191239__10109.55e-51.521880[89, 34]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_191239__101.json50.0missingmissingmissing
2200Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_190613__98100.01.457230[89, 40]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_190613__981.json50.00.5missing0.5
2201Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231213_212847__69600.00050956.229610[179, 280]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212847__696.json50.0missingmissingmissing
2202Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_183944__99300.00044353.793630[179, 236]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183944__993.json50.0missingmissingmissing
2203Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_183949__23900.00036253.727470[179, 182]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_183949__239.json50.0missingmissingmissing
2204Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_191232__53900.00021252.218070[179, 82]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191232__539.json0.0missingmissingmissing
2205Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruefalse520231227_191236__57900.00034753.535780[179, 172]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191236__579.json25.0missingmissingmissing
2206Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_190611__45600.02.460230[179, 70]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190611__456.json0.00.5missing0.5
2207Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231213_212907__11100.00048754.377590[312, 221]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212907__111.json50.0missingmissingmissing
2208Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231225_184018__73410.0005734.720112[312, 278]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184018__734.json80.0missingmissingmissing
2209Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231225_184024__90000.0006965.576460[312, 360]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184024__900.json50.0missingmissingmissing
2210Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_191303__75210.00064355.445362[312, 325]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191303__752.json80.0missingmissingmissing
2211Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_191310__74700.0006456.09150[312, 326]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191310__747.json50.0missingmissingmissing
2212Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190638__90210.07.98092[312, 331]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190638__902.json80.00.5missing0.5
2213Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231213_212902__79500.00054254.853150[311, 258]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_212902__795.json50.0missingmissingmissing
2214Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231225_184008__65900.00038052.783160[311, 150]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_184008__659.json50.0missingmissingmissing
2215Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231225_184013__39900.00056654.84620[311, 274]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_184013__399.json50.0missingmissingmissing
2216Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231227_191252__23500.0006196.023950[311, 309]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_191252__235.json50.0missingmissingmissing
2217Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231227_191258__32600.0006315.468530[311, 317]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_191258__326.json50.0missingmissingmissing
2218Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo--optimJuliaRecapTask1SHOTtruetrue520231215_190630__90850.07.624782[311, 331]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_190630__908.json100.00.5missing0.5
2219Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_212917__69100.0004493.594380[51, 199]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_212917__691.json0.0missingmissingmissing
2220Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_184035__19500.0003492.115820[51, 149]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_184035__195.json0.0missingmissingmissing
2221Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_184037__81900.0003612.045480[51, 155]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_184037__819.json0.0missingmissingmissing
2222Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_190650__41400.03.711120[51, 137]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_190650__414.json0.00.9missing0.1
2223Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106InJulia1SHOTtruefalse520231213_212914__14200.0004743.711380[54, 210]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_212914__142.json25.0missingmissingmissing
2224Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_184031__74710.0002641.605182[54, 105]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_184031__747.json80.0missingmissingmissing
2225Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_184033__88100.0004082.231070[54, 177]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_184033__881.json50.0missingmissingmissing
2226Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_191317__93010.00032.1572[54, 123]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_191317__930.json80.0missingmissingmissing
2227Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106InJulia1SHOTtruefalse520231227_191320__29500.000443.286090[54, 193]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_191320__295.json25.0missingmissingmissing
2228Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_190646__13510.04.198712[54, 174]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_190646__135.json80.00.9missing0.1
2229Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_212910__39510.0001570.7980982[89, 34]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_212910__395.json80.0missingmissingmissing
2230Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_184028__23410.0001610.9009672[89, 36]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_184028__234.json80.0missingmissingmissing
2231Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_184029__26210.0001571.237212[89, 34]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_184029__262.json80.0missingmissingmissing
2232Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_191314__67210.0001571.271452[89, 34]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_191314__672.json80.0missingmissingmissing
2233Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_191315__30550.0001631.035612[89, 37]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_191315__305.json100.0missingmissingmissing
2234Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_190642__43810.01.883372[89, 34]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_190642__438.json80.00.9missing0.1
2235Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_212909__22050.0003112.281842[179, 66]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212909__220.json100.0missingmissingmissing
2236Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTfalsefalse520231225_184025__68300.0003191.241530[179, 70]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184025__683.json0.0missingmissingmissing
2237Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_184027__17610.0003371.496182[179, 79]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184027__176.json80.0missingmissingmissing
2238Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_191311__18700.0003171.7780[179, 69]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191311__187.json25.0missingmissingmissing
2239Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_191312__95910.0002490.9882932[179, 35]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191312__959.json80.0missingmissingmissing
2240Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_190640__41510.01.358082[179, 63]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190640__415.json80.00.9missing0.1
2241Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231213_212921__20200.0005342.10840[312, 111]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_212921__202.json0.0missingmissingmissing
2242Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_184041__63700.0005521.669260[312, 120]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184041__637.json0.0missingmissingmissing
2243Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_184042__27600.0004341.054970[312, 61]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184042__276.json0.0missingmissingmissing
2244Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_191326__66200.0004942.235920[312, 91]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191326__662.json0.0missingmissingmissing
2245Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_191328__13900.0004421.914370[312, 65]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191328__139.json0.0missingmissingmissing
2246Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190658__61210.06.690832[312, 177]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190658__612.json80.00.9missing0.1
2247Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_212919__16910.0003971.335962[311, 43]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_212919__169.json80.0missingmissingmissing
2248Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_184038__61350.0004031.062512[311, 46]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_184038__613.json100.0missingmissingmissing
2249Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_184039__15110.0004091.028542[311, 49]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_184039__151.json80.0missingmissingmissing
2250Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_191322__38450.0005011.812892[311, 95]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_191322__384.json100.0missingmissingmissing
2251Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_191323__57110.0003891.038132[311, 39]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_191323__571.json80.0missingmissingmissing
2252Apple-MacBook-Pro-M1count_model_rowsgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_190651__92210.01.397152[311, 43]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_190651__922.json80.00.9missing0.1
2253Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewAsIs1SHOTfalsefalse520231213_213101__89500.0157541.92630[51, 508]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_213101__895.json0.0missingmissingmissing
2254Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_184220__34600.0095722.81220[51, 302]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_184220__346.json0.0missingmissingmissing
2255Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_184232__34900.009311.57270[51, 293]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_184232__349.json0.0missingmissingmissing
2256Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_190838__25700.030.660[51, 241]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_190838__257.json0.00.1missing0.9
2257Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewInJulia1SHOTtruetrue520231213_213019__82650.0121223.48112[54, 386]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_213019__826.json100.0missingmissingmissing
2258Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewInJulia1SHOTtruetrue520231225_184140__68750.0116120.70622[54, 369]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_184140__687.json100.0missingmissingmissing
2259Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewInJulia1SHOTtruetrue520231225_184157__58950.0123316.41342[54, 393]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_184157__589.json100.0missingmissingmissing
2260Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewInJulia1SHOTtruetrue520231227_191440__88750.0116721.71052[54, 371]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_191440__887.json100.0missingmissingmissing
2261Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewInJulia1SHOTtruetrue520231227_191512__96750.01232.39112[54, 382]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_191512__967.json100.0missingmissingmissing
2262Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_190807__16550.035.21132[54, 444]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_190807__165.json100.00.1missing0.9
2263Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_212956__26250.004289.234542[89, 113]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_212956__262.json100.0missingmissingmissing
2264Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_184110__34950.004257.306592[89, 112]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_184110__349.json100.0missingmissingmissing
2265Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_184119__94850.006149.854922[89, 175]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_184119__948.json100.0missingmissingmissing
2266Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_191411__73850.0070411.6952[89, 205]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_191411__738.json100.0missingmissingmissing
2267Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_191418__45350.004256.263562[89, 112]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_191418__453.json100.0missingmissingmissing
2268Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_190732__50450.08.429072[89, 132]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_190732__504.json100.00.1missing0.9
2269Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_212946__50950.0092325.70862[179, 248]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_212946__509.json100.0missingmissingmissing
2270Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_184051__65650.006988.897592[179, 173]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184051__656.json100.0missingmissingmissing
2271Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_184102__94850.0074610.96552[179, 189]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184102__948.json100.0missingmissingmissing
2272Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_191348__25750.0089320.26042[179, 238]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191348__257.json100.0missingmissingmissing
2273Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_191400__15450.0088711.7062[179, 236]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191400__154.json100.0missingmissingmissing
2274Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_190723__46750.025.63572[179, 262]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190723__467.json100.00.1missing0.9
2275Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_213147__20550.0128721.83272[312, 325]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213147__205.json100.0missingmissingmissing
2276Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_184314__75350.010058.426922[312, 231]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184314__753.json100.0missingmissingmissing
2277Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_184327__10550.0113413.23862[312, 274]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184327__105.json100.0missingmissingmissing
2278Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_191653__41650.0102917.57082[312, 239]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191653__416.json100.0missingmissingmissing
2279Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_191723__45250.0087330.31152[312, 187]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191723__452.json100.0missingmissingmissing
2280Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190922__41850.028.95562[312, 308]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190922__418.json100.00.1missing0.9
2281Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_213125__45510.0111523.76712[311, 268]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_213125__455.json80.0missingmissingmissing
2282Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_184252__80950.0138220.39682[311, 357]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_184252__809.json100.0missingmissingmissing
2283Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_184305__70550.0113913.21652[311, 276]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_184305__705.json100.0missingmissingmissing
2284Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_191529__83610.0130116.86072[311, 330]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_191529__836.json80.0missingmissingmissing
2285Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_191635__92450.0176965.73212[311, 486]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_191635__924.json100.0missingmissingmissing
2286Apple-MacBook-Pro-M1count_model_rowsgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_190853__91550.015.07092[311, 224]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_190853__915.json100.00.1missing0.9
2287Apple-MacBook-Pro-M1count_model_rowsllama2AsIs1SHOTfalsefalse520231213_233631__57000.013.29220[44, 403]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__AsIs__1SHOT__20231213_233631__570.json0.0missingmissingmissing
2288Apple-MacBook-Pro-M1count_model_rowsllama2AsIs1SHOTfalsefalse520231224_234524__39000.017.82150[44, 531]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__AsIs__1SHOT__20231224_234524__390.json0.0missing{\n "num_gpu": 99\n}missing
2289Apple-MacBook-Pro-M1count_model_rowsllama2AsIs1SHOTfalsefalse520231224_234535__80000.011.28270[1, 354]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__AsIs__1SHOT__20231224_234535__800.json0.0missing{\n "num_gpu": 99\n}missing
2290Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTfalsefalse520231213_233618__24800.013.23180[60, 399]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231213_233618__248.json0.0missingmissingmissing
2291Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTfalsefalse520231224_234455__22800.013.16990[60, 398]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231224_234455__228.json0.0missing{\n "num_gpu": 99\n}missing
2292Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTfalsefalse520231224_234506__26700.010.94980[1, 344]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231224_234506__267.json0.0missing{\n "num_gpu": 99\n}missing
2293Apple-MacBook-Pro-M1count_model_rowsllama2InJulia1SHOTtruefalse520231226_215449__13400.08.041320[60, 248]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__InJulia__1SHOT__20231226_215449__134.json25.0missing{\n "num_gpu": 99\n}missing
2294Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruetrue520231213_233605__93000.07.855290[90, 229]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231213_233605__930.json50.0missingmissingmissing
2295Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruetrue520231224_234436__40700.07.828150[90, 229]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_234436__407.json50.0missing{\n "num_gpu": 99\n}missing
2296Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruetrue520231224_234442__15300.05.748220[1, 183]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231224_234442__153.json50.0missing{\n "num_gpu": 99\n}missing
2297Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertAsk1SHOTtruefalse520231226_215441__59600.09.611070[90, 286]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_215441__596.json25.0missing{\n "num_gpu": 99\n}missing
2298Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruetrue520231213_233557__20200.016.53710[201, 438]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233557__202.json50.0missingmissingmissing
2299Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruetrue520231224_234411__98400.021.98942[219, 446]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234411__984.json75.0missing{\n "num_gpu": 99\n}missing
2300Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruetrue520231224_234428__37200.016.81160[1, 489]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234428__372.json50.0missing{\n "num_gpu": 99\n}missing
2301Apple-MacBook-Pro-M1count_model_rowsllama2JuliaExpertCoTTask1SHOTtruefalse520231226_215431__78300.015.26710[219, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215431__783.json25.0missing{\n "num_gpu": 99\n}missing
2302Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTfalsefalse520231213_233715__96700.023.9610[11, 642]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233715__967.json0.0missingmissingmissing
2303Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruefalse520231224_234629__22000.019.53440[11, 532]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234629__220.json25.0missing{\n "num_gpu": 99\n}missing
2304Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruetrue520231224_234645__77800.015.95470[1, 445]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234645__778.json50.0missing{\n "num_gpu": 99\n}missing
2305Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapCoTTask1SHOTtruetrue520231226_215527__13600.015.93010[11, 445]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215527__136.json50.0missing{\n "num_gpu": 99\n}missing
2306Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruefalse520231213_233651__67900.019.8980[361, 462]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231213_233651__679.json25.0missingmissingmissing
2307Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTfalsefalse520231224_234555__38000.019.39890[361, 450]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_234555__380.json0.0missing{\n "num_gpu": 99\n}missing
2308Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruefalse520231224_234610__41100.015.21640[1, 426]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231224_234610__411.json25.0missing{\n "num_gpu": 99\n}missing
2309Apple-MacBook-Pro-M1count_model_rowsllama2JuliaRecapTask1SHOTtruetrue520231226_215511__17300.021.80572[361, 520]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_215511__173.json75.0missing{\n "num_gpu": 99\n}missing
2310Apple-MacBook-Pro-M1count_model_rowsmagicoderAsIs1SHOTfalsefalse520231213_234541__52600.013.64530[44, 413]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__AsIs__1SHOT__20231213_234541__526.json0.0missingmissingmissing
2311Apple-MacBook-Pro-M1count_model_rowsmagicoderAsIs1SHOTfalsefalse520231225_000610__62700.04.210770[58, 135]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__AsIs__1SHOT__20231225_000610__627.json0.0missing{\n "num_gpu": 99\n}missing
2312Apple-MacBook-Pro-M1count_model_rowsmagicoderAsIs1SHOTfalsefalse520231225_000615__34400.04.308670[58, 138]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__AsIs__1SHOT__20231225_000615__344.json0.0missing{\n "num_gpu": 99\n}missing
2313Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruefalse520231213_234528__33400.022.16870[60, 642]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231213_234528__334.json25.0missingmissingmissing
2314Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruetrue520231225_000558__91000.08.120410[60, 267]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231225_000558__910.json50.0missing{\n "num_gpu": 99\n}missing
2315Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruefalse520231225_000606__66900.08.190330[60, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231225_000606__669.json25.0missing{\n "num_gpu": 99\n}missing
2316Apple-MacBook-Pro-M1count_model_rowsmagicoderInJulia1SHOTtruetrue520231226_220208__59500.05.944340[60, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__InJulia__1SHOT__20231226_220208__595.json50.0missing{\n "num_gpu": 99\n}missing
2317Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTtruetrue520231213_234505__55100.06.463710[90, 186]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231213_234505__551.json50.0missingmissingmissing
2318Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTtruetrue520231225_000541__14110.06.130972[100, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_000541__141.json80.0missing{\n "num_gpu": 99\n}missing
2319Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTfalsefalse520231225_000550__44500.08.803940[100, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_000550__445.json0.0missing{\n "num_gpu": 99\n}missing
2320Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertAsk1SHOTtruetrue520231226_220202__92200.08.756880[100, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_220202__922.json50.0missing{\n "num_gpu": 99\n}missing
2321Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231213_234459__57500.015.21930[201, 403]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234459__575.json0.0missingmissingmissing
2322Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_000528__45100.012.9830[211, 204]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000528__451.json0.0missing{\n "num_gpu": 99\n}missing
2323Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTtruefalse520231225_000534__85000.06.623460[211, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000534__850.json25.0missing{\n "num_gpu": 99\n}missing
2324Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaExpertCoTTask1SHOTtruefalse520231226_220153__36200.014.9320[211, 276]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220153__362.json25.0missing{\n "num_gpu": 99\n}missing
2325Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231213_234627__97200.024.85570[11, 665]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234627__972.json50.0missingmissingmissing
2326Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_000642__87900.010.30140[364, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000642__879.json50.0missing{\n "num_gpu": 99\n}missing
2327Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_000649__62500.06.710470[364, 167]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000649__625.json50.0missing{\n "num_gpu": 99\n}missing
2328Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_220223__53750.08.258332[364, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220223__537.json100.0missing{\n "num_gpu": 99\n}missing
2329Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTfalsefalse520231213_234602__93700.020.91370[361, 489]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231213_234602__937.json0.0missingmissingmissing
2330Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTtruefalse520231225_000622__25100.07.6730[361, 198]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_000622__251.json25.0missing{\n "num_gpu": 99\n}missing
2331Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTtruetrue520231225_000631__38500.08.947080[361, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_000631__385.json50.0missing{\n "num_gpu": 99\n}missing
2332Apple-MacBook-Pro-M1count_model_rowsmagicoderJuliaRecapTask1SHOTtruetrue520231226_220215__78150.06.854072[361, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_220215__781.json100.0missing{\n "num_gpu": 99\n}missing
2333Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175048__16500.08.99840[60, 174]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175048__165.json50.0missing{\n "num_gpu": 99\n}missing
2334Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175057__42950.08.39592[60, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175057__429.json100.0missing{\n "num_gpu": 99\n}missing
2335Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175116__34800.019.37070[60, 380]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175116__348.json50.0missing{\n "num_gpu": 99\n}missing
2336Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175014__30000.09.921160[100, 186]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175014__300.json50.0missing{\n "num_gpu": 99\n}missing
2337Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175029__47000.014.77040[100, 282]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175029__470.json50.0missing{\n "num_gpu": 99\n}missing
2338Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175039__30200.010.42790[100, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175039__302.json50.0missing{\n "num_gpu": 99\n}missing
2339Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_174934__85700.022.08240[211, 393]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174934__857.json50.0missing{\n "num_gpu": 99\n}missing
2340Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_174946__63700.012.20470[211, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_174946__637.json0.0missing{\n "num_gpu": 99\n}missing
2341Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_175004__81300.017.58410[211, 324]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175004__813.json25.0missing{\n "num_gpu": 99\n}missing
2342Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175215__66700.016.50310[364, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175215__667.json50.0missing{\n "num_gpu": 99\n}missing
2343Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175230__93500.015.2010[364, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175230__935.json50.0missing{\n "num_gpu": 99\n}missing
2344Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_175245__18300.014.48490[364, 244]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175245__183.json25.0missing{\n "num_gpu": 99\n}missing
2345Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_175132__70600.015.2040[361, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175132__706.json25.0missing{\n "num_gpu": 99\n}missing
2346Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175143__13010.011.26412[361, 182]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175143__130.json80.0missing{\n "num_gpu": 99\n}missing
2347Apple-MacBook-Pro-M1count_model_rowsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175158__94100.015.00390[361, 254]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175158__941.json50.0missing{\n "num_gpu": 99\n}missing
2348Apple-MacBook-Pro-M1count_model_rowsmistral-mediumAsIs1SHOTfalsefalse520231213_213403__20700.0019876320.37760[56, 227]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__AsIs__1SHOT__20231213_213403__207.json0.0missingmissingmissing
2349Apple-MacBook-Pro-M1count_model_rowsmistral-mediumAsIs1SHOTfalsefalse520231225_184658__22000.0037269812.73590[56, 442]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__AsIs__1SHOT__20231225_184658__220.json0.0missingmissingmissing
2350Apple-MacBook-Pro-M1count_model_rowsmistral-mediumAsIs1SHOTfalsefalse520231225_184717__99600.0035004618.41160[56, 414]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__AsIs__1SHOT__20231225_184717__996.json0.0missingmissingmissing
2351Apple-MacBook-Pro-M1count_model_rowsmistral-medium--optimAsIs1SHOTfalsefalse520231215_191211__82600.045.66770[56, 505]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__AsIs__1SHOT__20231215_191211__826.json0.00.9missing0.3
2352Apple-MacBook-Pro-M1count_model_rowsmistral-mediumInJulia1SHOTtruetrue520231213_213343__52310.0018474117.95222[58, 209]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__InJulia__1SHOT__20231213_213343__523.json80.0missingmissingmissing
2353Apple-MacBook-Pro-M1count_model_rowsmistral-mediumInJulia1SHOTtruetrue520231225_184641__10510.003392613.44892[58, 400]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__InJulia__1SHOT__20231225_184641__105.json80.0missingmissingmissing
2354Apple-MacBook-Pro-M1count_model_rowsmistral-mediumInJulia1SHOTtruetrue520231225_184645__62650.001717974.396612[58, 193]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__InJulia__1SHOT__20231225_184645__626.json100.0missingmissingmissing
2355Apple-MacBook-Pro-M1count_model_rowsmistral-mediumInJulia1SHOTtruetrue520231227_192037__88300.001661348.757760[58, 186]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__InJulia__1SHOT__20231227_192037__883.json50.0missingmissingmissing
2356Apple-MacBook-Pro-M1count_model_rowsmistral-mediumInJulia1SHOTtruetrue520231227_192043__21350.001426736.013172[58, 157]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__InJulia__1SHOT__20231227_192043__213.json100.0missingmissingmissing
2357Apple-MacBook-Pro-M1count_model_rowsmistral-medium--optimInJulia1SHOTtruetrue520231215_191125__17150.022.95992[58, 255]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__InJulia__1SHOT__20231215_191125__171.json100.00.9missing0.3
2358Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_213325__78850.001275859.829082[98, 125]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_213325__788.json100.0missingmissingmissing
2359Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_184621__64650.001308212.985582[98, 129]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_184621__646.json100.0missingmissingmissing
2360Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_184627__48050.001243495.763652[98, 121]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_184627__480.json100.0missingmissingmissing
2361Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_192016__21500.001461927.662960[98, 148]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_192016__215.json50.0missingmissingmissing
2362Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_192028__69650.0014133812.4412[98, 142]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_192028__696.json100.0missingmissingmissing
2363Apple-MacBook-Pro-M1count_model_rowsmistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_191102__36250.013.01262[98, 122]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_191102__362.json100.00.9missing0.3
2364Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_213315__22500.0029508524.98290[209, 295]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213315__225.json50.0missingmissingmissing
2365Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_184554__29550.0033634430.09772[209, 346]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184554__295.json100.0missingmissingmissing
2366Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_184618__24910.0050866124.17322[209, 559]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184618__249.json80.0missingmissingmissing
2367Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_191933__31900.0036789526.59410[209, 385]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191933__319.json25.0missingmissingmissing
2368Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_192008__66710.0041643535.23621[209, 445]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192008__667.json67.5missingmissingmissing
2369Apple-MacBook-Pro-M1count_model_rowsmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_191049__29050.037.29212[209, 373]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_191049__290.json100.00.9missing0.3
2370Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_213535__91410.0060066853.09231[361, 622]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213535__914.json67.5missingmissingmissing
2371Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_184801__52410.0056264513.13362[361, 575]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184801__524.json80.0missingmissingmissing
2372Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_184816__68750.004048914.54882[361, 380]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184816__687.json100.0missingmissingmissing
2373Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_192158__10350.0058934234.96472[361, 608]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192158__103.json100.0missingmissingmissing
2374Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_192226__57810.0034340627.25851[361, 304]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192226__578.json67.5missingmissingmissing
2375Apple-MacBook-Pro-M1count_model_rowsmistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_191448__28500.092.97910[361, 640]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_191448__285.json50.00.9missing0.3
2376Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapTask1SHOTtruetrue520231213_213441__93650.0047446338.27992[358, 467]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_213441__936.json100.0missingmissingmissing
2377Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapTask1SHOTtruetrue520231225_184732__83310.0058448715.03831[358, 603]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_184732__833.json67.5missingmissingmissing
2378Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapTask1SHOTtruetrue520231225_184748__98700.0065972415.93940[358, 696]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_184748__987.json50.0missingmissingmissing
2379Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapTask1SHOTtruetrue520231227_192102__83410.0076893918.95422[358, 831]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_192102__834.json80.0missingmissingmissing
2380Apple-MacBook-Pro-M1count_model_rowsmistral-mediumJuliaRecapTask1SHOTtruetrue520231227_192123__98810.0056830720.6852[358, 583]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_192123__988.json80.0missingmissingmissing
2381Apple-MacBook-Pro-M1count_model_rowsmistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_191315__65810.064.07252[358, 690]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_191315__658.json80.00.9missing0.3
2382Apple-MacBook-Pro-M1count_model_rowsmistral-smallAsIs1SHOTfalsefalse520231213_213242__48900.0005923655.443260[55, 287]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__AsIs__1SHOT__20231213_213242__489.json0.0missingmissingmissing
2383Apple-MacBook-Pro-M1count_model_rowsmistral-smallAsIs1SHOTfalsefalse520231225_184444__25900.0005632653.756260[55, 272]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__AsIs__1SHOT__20231225_184444__259.json0.0missingmissingmissing
2384Apple-MacBook-Pro-M1count_model_rowsmistral-smallAsIs1SHOTfalsefalse520231225_184446__28300.0003227052.177830[55, 148]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__AsIs__1SHOT__20231225_184446__283.json0.0missingmissingmissing
2385Apple-MacBook-Pro-M1count_model_rowsmistral-small--optimAsIs1SHOTfalsefalse520231215_190957__73500.05.769260[55, 445]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__AsIs__1SHOT__20231215_190957__735.json0.00.9missing0.3
2386Apple-MacBook-Pro-M1count_model_rowsmistral-smallInJulia1SHOTtruetrue520231213_213237__20550.0005703795.127492[57, 275]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__InJulia__1SHOT__20231213_213237__205.json100.0missingmissingmissing
2387Apple-MacBook-Pro-M1count_model_rowsmistral-smallInJulia1SHOTtruetrue520231225_184437__70450.0004306992.763992[57, 203]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__InJulia__1SHOT__20231225_184437__704.json100.0missingmissingmissing
2388Apple-MacBook-Pro-M1count_model_rowsmistral-smallInJulia1SHOTtruetrue520231225_184440__83410.0003938392.613912[57, 184]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__InJulia__1SHOT__20231225_184440__834.json80.0missingmissingmissing
2389Apple-MacBook-Pro-M1count_model_rowsmistral-smallInJulia1SHOTtruetrue520231227_191838__51350.0004597993.063832[57, 218]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__InJulia__1SHOT__20231227_191838__513.json100.0missingmissingmissing
2390Apple-MacBook-Pro-M1count_model_rowsmistral-smallInJulia1SHOTtruetrue520231227_191841__47250.0004306992.813912[57, 203]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__InJulia__1SHOT__20231227_191841__472.json100.0missingmissingmissing
2391Apple-MacBook-Pro-M1count_model_rowsmistral-small--optimInJulia1SHOTtruetrue520231215_190952__66250.04.119542[57, 310]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__InJulia__1SHOT__20231215_190952__662.json100.00.9missing0.3
2392Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertAsk1SHOTtruetrue520231213_213232__35210.0006460536.30382[99, 300]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_213232__352.json80.0missingmissingmissing
2393Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_184432__59800.0003220731.933230[99, 133]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_184432__598.json50.0missingmissingmissing
2394Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_184435__62910.0004132532.719182[99, 180]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_184435__629.json80.0missingmissingmissing
2395Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertAsk1SHOTtruetrue520231227_191833__62800.0006305334.03680[99, 292]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_191833__628.json50.0missingmissingmissing
2396Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertAsk1SHOTtruetrue520231227_191835__79600.0002890931.737490[99, 116]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_191835__796.json50.0missingmissingmissing
2397Apple-MacBook-Pro-M1count_model_rowsmistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_190947__73510.03.794262[99, 273]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_190947__735.json80.00.9missing0.3
2398Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_213225__95050.000824577.629362[210, 355]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213225__950.json100.0missingmissingmissing
2399Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertCoTTask1SHOTtruefalse520231225_184424__13200.000952615.764390[210, 421]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184424__132.json25.0missingmissingmissing
2400Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_184430__11800.000927395.721220[210, 408]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184430__118.json50.0missingmissingmissing
2401Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_191824__70050.000735335.946812[210, 309]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191824__700.json100.0missingmissingmissing
2402Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_191829__34550.000756674.867342[210, 320]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191829__345.json100.0missingmissingmissing
2403Apple-MacBook-Pro-M1count_model_rowsmistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_190944__51450.04.325912[210, 320]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190944__514.json100.00.9missing0.3
2404Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_213250__50610.0009966356.213212[365, 392]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213250__506.json80.0missingmissingmissing
2405Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapCoTTask1SHOTfalsefalse520231225_184513__53800.00115967.679290[365, 476]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184513__538.json0.0missingmissingmissing
2406Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_184524__19210.0013477811.15822[365, 573]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184524__192.json80.0missingmissingmissing
2407Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_191858__66500.0009461955.13950[365, 366]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191858__665.json50.0missingmissingmissing
2408Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_191906__72510.001433148.470342[365, 617]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191906__725.json80.0missingmissingmissing
2409Apple-MacBook-Pro-M1count_model_rowsmistral-small--optimJuliaRecapCoTTask1SHOTtruetrue520231215_191012__42650.07.511632[365, 545]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_191012__426.json100.00.9missing0.3
2410Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapTask1SHOTfalsefalse520231213_213243__42400.0003376810.988920[363, 53]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_213243__424.json0.0missingmissingmissing
2411Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapTask1SHOTtruetrue520231225_184459__92750.0017461212.45262[363, 779]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_184459__927.json100.0missingmissingmissing
2412Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapTask1SHOTfalsefalse520231225_184505__44500.001136966.304930[363, 465]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_184505__445.json0.0missingmissingmissing
2413Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapTask1SHOTtruefalse520231227_191846__14500.001039965.645860[363, 415]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_191846__145.json25.0missingmissingmissing
2414Apple-MacBook-Pro-M1count_model_rowsmistral-smallJuliaRecapTask1SHOTtruetrue520231227_191852__83550.00106135.902622[363, 426]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_191852__835.json100.0missingmissingmissing
2415Apple-MacBook-Pro-M1count_model_rowsmistral-small--optimJuliaRecapTask1SHOTfalsefalse520231215_191004__43900.06.500110[363, 483]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_191004__439.json0.00.9missing0.3
2416Apple-MacBook-Pro-M1count_model_rowsmistral-tinyAsIs1SHOTfalsefalse520231213_213208__24200.0001657975.066280[55, 349]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__AsIs__1SHOT__20231213_213208__242.json0.0missingmissingmissing
2417Apple-MacBook-Pro-M1count_model_rowsmistral-tinyAsIs1SHOTfalsefalse520231225_184358__64500.000166253.050080[55, 350]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__AsIs__1SHOT__20231225_184358__645.json0.0missingmissingmissing
2418Apple-MacBook-Pro-M1count_model_rowsmistral-tinyAsIs1SHOTfalsefalse520231225_184401__75000.0001331812.430070[55, 277]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__AsIs__1SHOT__20231225_184401__750.json0.0missingmissingmissing
2419Apple-MacBook-Pro-M1count_model_rowsmistral-tiny--optimAsIs1SHOTfalsefalse520231215_190934__71100.02.784020[55, 315]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__AsIs__1SHOT__20231215_190934__711.json0.00.9missing0.3
2420Apple-MacBook-Pro-M1count_model_rowsmistral-tinyInJulia1SHOTtruetrue520231213_213202__63010.000171063.727431[57, 360]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__InJulia__1SHOT__20231213_213202__630.json67.5missingmissingmissing
2421Apple-MacBook-Pro-M1count_model_rowsmistral-tinyInJulia1SHOTtruetrue520231225_184353__97700.0001099051.984110[57, 225]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__InJulia__1SHOT__20231225_184353__977.json50.0missingmissingmissing
2422Apple-MacBook-Pro-M1count_model_rowsmistral-tinyInJulia1SHOTtruetrue520231225_184355__65310.0001244012.310851[57, 257]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__InJulia__1SHOT__20231225_184355__653.json67.5missingmissingmissing
2423Apple-MacBook-Pro-M1count_model_rowsmistral-tinyInJulia1SHOTfalsefalse520231227_191749__75000.0002168134.118110[57, 461]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__InJulia__1SHOT__20231227_191749__750.json0.0missingmissingmissing
2424Apple-MacBook-Pro-M1count_model_rowsmistral-tinyInJulia1SHOTtruetrue520231227_191753__86800.000220894.229250[57, 470]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__InJulia__1SHOT__20231227_191753__868.json50.0missingmissingmissing
2425Apple-MacBook-Pro-M1count_model_rowsmistral-tiny--optimInJulia1SHOTtruetrue520231215_190931__83510.03.329091[57, 376]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__InJulia__1SHOT__20231215_190931__835.json67.50.9missing0.3
2426Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_213159__59707.3656e-52.156450[99, 132]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_213159__597.json50.0missingmissingmissing
2427Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_184349__15907.8639e-510.6130[99, 143]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_184349__159.json50.0missingmissingmissing
2428Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_184350__14118.7699e-51.516591[99, 163]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_184350__141.json67.5missingmissingmissing
2429Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_191743__17909.9477e-57.328260[99, 189]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_191743__179.json50.0missingmissingmissing
2430Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_191745__76107.5468e-51.415750[99, 136]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_191745__761.json50.0missingmissingmissing
2431Apple-MacBook-Pro-M1count_model_rowsmistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_190927__12300.01.016560[99, 109]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_190927__123.json50.00.9missing0.3
2432Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231213_213156__45600.0002237378.992270[210, 429]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213156__456.json0.0missingmissingmissing
2433Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_184335__51100.0001884037.907262[210, 351]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184335__511.json75.0missingmissingmissing
2434Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_184338__10700.0001589582.684680[210, 286]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184338__107.json50.0missingmissingmissing
2435Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_191730__49700.0001358557.379080[210, 235]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191730__497.json50.0missingmissingmissing
2436Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_191736__58900.0002504645.367432[210, 488]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_191736__589.json75.0missingmissingmissing
2437Apple-MacBook-Pro-M1count_model_rowsmistral-tiny--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_190926__61800.04.343780[210, 268]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_190926__618.json0.00.9missing0.3
2438Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_213218__14400.0002762414.848180[365, 497]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213218__144.json50.0missingmissingmissing
2439Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_184412__66000.0002214283.270522[365, 376]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184412__660.json75.0missingmissingmissing
2440Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_184418__93910.0003641236.058591[365, 691]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184418__939.json67.5missingmissingmissing
2441Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_191815__70500.00037001211.85410[365, 704]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191815__705.json50.0missingmissingmissing
2442Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_191818__74510.000205123.23611[365, 340]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_191818__745.json67.5missingmissingmissing
2443Apple-MacBook-Pro-M1count_model_rowsmistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_190939__61510.02.613281[365, 291]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_190939__615.json67.50.9missing0.3
2444Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapTask1SHOTtruetrue520231213_213213__22910.0002419864.918061[363, 422]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_213213__229.json67.5missingmissingmissing
2445Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapTask1SHOTtruetrue520231225_184405__76900.0002424393.811940[363, 423]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_184405__769.json50.0missingmissingmissing
2446Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapTask1SHOTtruetrue520231225_184409__17800.0002478753.880350[363, 435]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_184409__178.json50.0missingmissingmissing
2447Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapTask1SHOTtruetrue520231227_191758__31100.0002519524.214540[363, 444]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_191758__311.json50.0missingmissingmissing
2448Apple-MacBook-Pro-M1count_model_rowsmistral-tinyJuliaRecapTask1SHOTtruetrue520231227_191803__53800.0002782264.655880[363, 502]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_191803__538.json50.0missingmissingmissing
2449Apple-MacBook-Pro-M1count_model_rowsmistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_190936__43300.02.47790[363, 275]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_190936__433.json50.00.9missing0.3
2450Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_215734__96700.010.00060[44, 306]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_215734__967.json0.0missingmissingmissing
2451Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_215747__73200.012.87720[1, 402]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_215747__732.json0.0missingmissingmissing
2452Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_215801__29900.013.83550[1, 430]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_215801__299.json0.0missingmissingmissing
2453Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_003522__57700.02.794780[53, 64]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_003522__577.json0.0missing{\n "num_gpu": 99\n}missing
2454Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_003528__87200.05.130020[53, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_003528__872.json0.0missing{\n "num_gpu": 99\n}missing
2455Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_215710__58700.011.72710[1, 368]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_215710__587.json25.0missingmissingmissing
2456Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_215724__73400.013.44370[1, 418]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_215724__734.json0.0missingmissingmissing
2457Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_003514__20510.013.51211[56, 343]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_003514__205.json67.5missing{\n "num_gpu": 99\n}missing
2458Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_003519__29600.05.212060[56, 128]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_003519__296.json50.0missing{\n "num_gpu": 99\n}missing
2459Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231226_221455__48800.05.93370[56, 147]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_221455__488.json25.0missing{\n "num_gpu": 99\n}missing
2460Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_215620__88200.06.51072[1, 207]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215620__882.json75.0missingmissingmissing
2461Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_215638__18800.018.42530[1, 553]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215638__188.json50.0missingmissingmissing
2462Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_003458__68100.03.474130[98, 74]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003458__681.json0.0missing{\n "num_gpu": 99\n}missing
2463Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_003501__64600.02.230430[98, 41]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003501__646.json0.0missing{\n "num_gpu": 99\n}missing
2464Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_221449__50100.02.803550[98, 56]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221449__501.json0.0missing{\n "num_gpu": 99\n}missing
2465Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_215550__73400.08.983510[1, 272]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215550__734.json50.0missingmissingmissing
2466Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_215603__21000.012.89470[1, 383]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215603__210.json50.0missingmissingmissing
2467Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_003442__92900.015.8390[209, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003442__929.json25.0missing{\n "num_gpu": 99\n}missing
2468Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_003455__23200.013.17290[209, 309]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003455__232.json0.0missing{\n "num_gpu": 99\n}missing
2469Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_221446__63600.010.75120[209, 110]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221446__636.json25.0missing{\n "num_gpu": 99\n}missing
2470Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_215931__41700.019.0540[1, 526]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215931__417.json50.0missingmissingmissing
2471Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_215942__85600.011.17120[1, 319]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215942__856.json50.0missingmissingmissing
2472Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_003600__98100.011.51320[365, 242]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003600__981.json0.0missing{\n "num_gpu": 99\n}missing
2473Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003610__91610.09.92141[365, 202]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003610__916.json67.5missing{\n "num_gpu": 99\n}missing
2474Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_221537__61900.020.16220[365, 455]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221537__619.json50.0missing{\n "num_gpu": 99\n}missing
2475Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_215838__36900.015.3461[1, 431]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215838__369.json62.5missingmissingmissing
2476Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_215855__49200.017.31690[1, 482]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215855__492.json25.0missingmissingmissing
2477Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003537__79110.09.645231[363, 195]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003537__791.json67.5missing{\n "num_gpu": 99\n}missing
2478Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_003549__32800.010.89390[363, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003549__328.json25.0missing{\n "num_gpu": 99\n}missing
2479Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231226_221516__38000.021.48070[363, 487]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221516__380.json0.0missing{\n "num_gpu": 99\n}missing
2480Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224733__81600.010.43850[55, 335]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224733__816.json50.0missing{\n "num_gpu": 99\n}missing
2481Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_224746__85500.012.22690[55, 392]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224746__855.json0.0missing{\n "num_gpu": 99\n}missing
2482Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224759__93100.013.61060[55, 436]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224759__931.json50.0missing{\n "num_gpu": 99\n}missing
2483Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224816__76200.016.72340[55, 535]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224816__762.json50.0missing{\n "num_gpu": 99\n}missing
2484Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_224823__81900.06.505450[55, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_224823__819.json50.0missing{\n "num_gpu": 99\n}missing
2485Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224709__31700.02.335560[97, 58]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224709__317.json50.0missing{\n "num_gpu": 99\n}missing
2486Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224712__22210.02.206181[97, 54]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224712__222.json67.5missing{\n "num_gpu": 99\n}missing
2487Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_224714__15700.02.297440[97, 56]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224714__157.json0.0missing{\n "num_gpu": 99\n}missing
2488Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224720__72500.05.949030[97, 177]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224720__725.json50.0missing{\n "num_gpu": 99\n}missing
2489Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_224723__34800.02.217170[97, 54]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_224723__348.json50.0missing{\n "num_gpu": 99\n}missing
2490Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224621__19800.014.98472[208, 416]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224621__198.json75.0missing{\n "num_gpu": 99\n}missing
2491Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224634__96600.013.1070[208, 390]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224634__966.json50.0missing{\n "num_gpu": 99\n}missing
2492Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224649__82600.015.0972[208, 452]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224649__826.json75.0missing{\n "num_gpu": 99\n}missing
2493Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_224659__53100.09.975390[208, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224659__531.json50.0missing{\n "num_gpu": 99\n}missing
2494Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_224707__29100.07.689190[208, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_224707__291.json25.0missing{\n "num_gpu": 99\n}missing
2495Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_224955__26500.014.4580[364, 401]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_224955__265.json25.0missing{\n "num_gpu": 99\n}missing
2496Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_225012__67100.016.33430[364, 458]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225012__671.json50.0missing{\n "num_gpu": 99\n}missing
2497Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_225024__36000.012.29920[364, 334]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225024__360.json0.0missing{\n "num_gpu": 99\n}missing
2498Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_225041__11700.016.68222[364, 469]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225041__117.json75.0missing{\n "num_gpu": 99\n}missing
2499Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_225056__55500.015.54440[364, 434]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225056__555.json25.0missing{\n "num_gpu": 99\n}missing
2500Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224839__20210.015.94372[362, 447]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224839__202.json80.0missing{\n "num_gpu": 99\n}missing
2501Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224858__74300.018.47950[362, 522]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224858__743.json50.0missing{\n "num_gpu": 99\n}missing
2502Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224910__68800.011.88070[362, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224910__688.json50.0missing{\n "num_gpu": 99\n}missing
2503Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224924__45200.014.12741[362, 391]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224924__452.json62.5missing{\n "num_gpu": 99\n}missing
2504Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_224941__48600.015.76830[362, 441]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_224941__486.json50.0missing{\n "num_gpu": 99\n}missing
2505Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225244__80800.010.87580[55, 274]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225244__808.json50.0missing{\n "num_gpu": 99\n}missing
2506Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_225303__72900.019.36720[55, 490]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225303__729.json0.0missing{\n "num_gpu": 99\n}missing
2507Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225319__40510.015.68361[55, 397]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225319__405.json67.5missing{\n "num_gpu": 99\n}missing
2508Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225337__69310.017.49941[55, 443]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225337__693.json67.5missing{\n "num_gpu": 99\n}missing
2509Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_225355__67800.018.35850[55, 465]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_225355__678.json50.0missing{\n "num_gpu": 99\n}missing
2510Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225215__82400.06.021550[97, 140]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225215__824.json50.0missing{\n "num_gpu": 99\n}missing
2511Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225221__30400.05.922140[97, 137]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225221__304.json50.0missing{\n "num_gpu": 99\n}missing
2512Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225226__47300.04.163560[97, 91]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225226__473.json50.0missing{\n "num_gpu": 99\n}missing
2513Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225229__85400.03.308120[97, 69]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225229__854.json50.0missing{\n "num_gpu": 99\n}missing
2514Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_225233__25200.03.458890[97, 73]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_225233__252.json50.0missing{\n "num_gpu": 99\n}missing
2515Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_225110__62810.013.10331[208, 285]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225110__628.json67.5missing{\n "num_gpu": 99\n}missing
2516Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_225123__77900.013.59672[208, 318]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225123__779.json75.0missing{\n "num_gpu": 99\n}missing
2517Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_225135__78200.011.76920[208, 272]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225135__782.json25.0missing{\n "num_gpu": 99\n}missing
2518Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_225153__94000.018.39070[208, 438]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225153__940.json50.0missing{\n "num_gpu": 99\n}missing
2519Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_225209__97200.015.61150[208, 369]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225209__972.json0.0missing{\n "num_gpu": 99\n}missing
2520Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_225546__40200.010.54310[364, 216]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225546__402.json50.0missing{\n "num_gpu": 99\n}missing
2521Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_225608__90710.021.28661[364, 480]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225608__907.json67.5missing{\n "num_gpu": 99\n}missing
2522Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_225625__90400.016.96810[364, 375]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225625__904.json0.0missing{\n "num_gpu": 99\n}missing
2523Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_225636__97000.011.85150[364, 249]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225636__970.json50.0missing{\n "num_gpu": 99\n}missing
2524Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_225658__67300.020.8260[364, 469]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_225658__673.json0.0missing{\n "num_gpu": 99\n}missing
2525Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225415__37500.019.5050[362, 437]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225415__375.json50.0missing{\n "num_gpu": 99\n}missing
2526Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225428__88400.013.17640[362, 282]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225428__884.json50.0missing{\n "num_gpu": 99\n}missing
2527Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_225445__23400.016.27740[362, 358]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225445__234.json25.0missing{\n "num_gpu": 99\n}missing
2528Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225509__98600.024.42870[362, 556]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225509__986.json50.0missing{\n "num_gpu": 99\n}missing
2529Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_225536__59500.026.0550[362, 595]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_225536__595.json50.0missing{\n "num_gpu": 99\n}missing
2530Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_120315__26100.014.22490[52, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_120315__261.json0.0missing{\n "num_gpu": 99\n}missing
2531Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_120328__96300.013.14240[52, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_120328__963.json0.0missing{\n "num_gpu": 99\n}missing
2532Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120244__33000.015.44740[55, 284]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120244__330.json50.0missing{\n "num_gpu": 99\n}missing
2533Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120301__20500.016.5910[55, 305]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120301__205.json50.0missing{\n "num_gpu": 99\n}missing
2534Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_221745__73400.013.17330[55, 243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_221745__734.json0.0missing{\n "num_gpu": 99\n}missing
2535Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_120223__30000.010.31570[97, 181]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120223__300.json0.0missing{\n "num_gpu": 99\n}missing
2536Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_120228__75700.05.801720[97, 96]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120228__757.json50.0missing{\n "num_gpu": 99\n}missing
2537Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_221732__25900.04.857360[97, 79]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_221732__259.json50.0missing{\n "num_gpu": 99\n}missing
2538Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120152__58000.020.92270[208, 365]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120152__580.json50.0missing{\n "num_gpu": 99\n}missing
2539Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120212__47800.019.98632[208, 348]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120212__478.json75.0missing{\n "num_gpu": 99\n}missing
2540Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_221727__44610.025.80751[208, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221727__446.json67.5missing{\n "num_gpu": 99\n}missing
2541Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120435__89300.022.47040[364, 372]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120435__893.json50.0missing{\n "num_gpu": 99\n}missing
2542Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120503__23910.028.10811[364, 473]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120503__239.json67.5missing{\n "num_gpu": 99\n}missing
2543Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_221851__10700.028.11580[364, 477]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221851__107.json50.0missing{\n "num_gpu": 99\n}missing
2544Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120351__68800.022.5180[362, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120351__688.json50.0missing{\n "num_gpu": 99\n}missing
2545Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120412__20610.021.55631[362, 356]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120412__206.json67.5missing{\n "num_gpu": 99\n}missing
2546Apple-MacBook-Pro-M1count_model_rowsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_221823__91710.038.09781[362, 655]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_221823__917.json67.5missing{\n "num_gpu": 99\n}missing
2547Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_103555__56510.041.59981[61, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_103555__565.json67.5missing{\n "num_gpu": 99\n}missing
2548Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_103621__85100.025.91090[61, 145]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_103621__851.json50.0missing{\n "num_gpu": 99\n}missing
2549Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_103712__36100.049.99460[61, 276]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_103712__361.json50.0missing{\n "num_gpu": 99\n}missing
2550Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142911__27700.031.66570[61, 186]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142911__277.json50.0missing{\n "num_gpu": 99\n}missing
2551Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_142956__18500.044.4840[61, 264]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_142956__185.json50.0missing{\n "num_gpu": 99\n}missing
2552Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_103449__12700.013.57080[100, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_103449__127.json0.0missing{\n "num_gpu": 99\n}missing
2553Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_103500__68000.011.31950[100, 51]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_103500__680.json50.0missing{\n "num_gpu": 99\n}missing
2554Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_103513__76750.013.04912[100, 62]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_103513__767.json100.0missing{\n "num_gpu": 99\n}missing
2555Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_142756__75600.08.55010[100, 34]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_142756__756.json0.0missing{\n "num_gpu": 99\n}missing
2556Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_142839__22100.043.26311[100, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_142839__221.json62.5missing{\n "num_gpu": 99\n}missing
2557Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_103220__80600.067.22720[211, 338]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_103220__806.json25.0missing{\n "num_gpu": 99\n}missing
2558Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_103340__17500.080.44410[211, 443]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_103340__175.json50.0missing{\n "num_gpu": 99\n}missing
2559Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_103435__71910.054.7441[211, 299]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_103435__719.json67.5missing{\n "num_gpu": 99\n}missing
2560Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_142731__38400.059.9870[211, 330]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_142731__384.json25.0missing{\n "num_gpu": 99\n}missing
2561Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_142747__96900.016.00410[211, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_142747__969.json0.0missing{\n "num_gpu": 99\n}missing
2562Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_104055__29100.046.48480[374, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104055__291.json50.0missing{\n "num_gpu": 99\n}missing
2563Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_104201__59710.065.17421[374, 332]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104201__597.json67.5missing{\n "num_gpu": 99\n}missing
2564Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_104309__91500.068.08331[374, 349]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104309__915.json62.5missing{\n "num_gpu": 99\n}missing
2565Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_143301__23650.042.29012[374, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_143301__236.json100.0missing{\n "num_gpu": 99\n}missing
2566Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_143345__59710.043.63461[374, 204]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_143345__597.json67.5missing{\n "num_gpu": 99\n}missing
2567Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_103804__53100.050.99490[372, 237]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_103804__531.json50.0missing{\n "num_gpu": 99\n}missing
2568Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_103944__95500.099.63070[372, 525]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_103944__955.json50.0missing{\n "num_gpu": 99\n}missing
2569Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_104009__83900.024.77350[372, 92]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_104009__839.json0.0missing{\n "num_gpu": 99\n}missing
2570Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_143049__14500.052.98370[372, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_143049__145.json0.0missing{\n "num_gpu": 99\n}missing
2571Apple-MacBook-Pro-M1count_model_rowsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_143219__47700.089.8370[372, 474]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_143219__477.json50.0missing{\n "num_gpu": 99\n}missing
2572Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_220152__84600.017.85220[44, 534]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_220152__846.json0.0missingmissingmissing
2573Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_220210__96100.017.36590[1, 530]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_220210__961.json0.0missingmissingmissing
2574Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_220223__33800.012.81670[1, 400]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_220223__338.json0.0missingmissingmissing
2575Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_003717__52500.09.936280[61, 251]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_003717__525.json0.0missing{\n "num_gpu": 99\n}missing
2576Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_003723__40400.05.56810[61, 137]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_003723__404.json0.0missing{\n "num_gpu": 99\n}missing
2577Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_220119__79800.015.29350[1, 471]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_220119__798.json0.0missingmissingmissing
2578Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231219_220134__44300.015.57540[1, 479]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_220134__443.json25.0missingmissingmissing
2579Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_003701__36610.08.351181[64, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_003701__366.json67.5missing{\n "num_gpu": 99\n}missing
2580Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_003707__11800.06.605280[64, 164]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_003707__118.json50.0missing{\n "num_gpu": 99\n}missing
2581Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231226_221601__57300.06.491090[64, 161]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_221601__573.json25.0missing{\n "num_gpu": 99\n}missing
2582Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_220051__41200.03.213470[1, 104]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_220051__412.json50.0missingmissingmissing
2583Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_220052__95500.01.537990[1, 50]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_220052__955.json0.0missingmissingmissing
2584Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_003647__34300.02.843940[106, 57]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003647__343.json50.0missing{\n "num_gpu": 99\n}missing
2585Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_003652__57400.04.680830[106, 105]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003652__574.json50.0missing{\n "num_gpu": 99\n}missing
2586Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_221555__51700.03.562130[106, 76]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221555__517.json50.0missing{\n "num_gpu": 99\n}missing
2587Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_220016__59900.016.90620[1, 493]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220016__599.json0.0missingmissingmissing
2588Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_220032__67400.015.94530[1, 467]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220032__674.json0.0missingmissingmissing
2589Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003631__88900.020.87870[217, 342]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003631__889.json50.0missing{\n "num_gpu": 99\n}missing
2590Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003644__38900.013.25270[217, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003644__389.json50.0missing{\n "num_gpu": 99\n}missing
2591Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_221551__43100.014.50610[217, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221551__431.json25.0missing{\n "num_gpu": 99\n}missing
2592Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_220354__44500.023.62060[1, 641]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220354__445.json50.0missingmissingmissing
2593Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_220356__92000.01.892880[1, 56]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220356__920.json0.0missingmissingmissing
2594Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003750__20400.010.74890[373, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003750__204.json50.0missing{\n "num_gpu": 99\n}missing
2595Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_003802__71710.011.41221[373, 239]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003802__717.json67.5missing{\n "num_gpu": 99\n}missing
2596Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_221623__54000.011.94980[373, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221623__540.json50.0missing{\n "num_gpu": 99\n}missing
2597Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_220300__26400.019.84960[1, 547]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_220300__264.json0.0missingmissingmissing
2598Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_220318__58900.017.69380[1, 492]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_220318__589.json25.0missingmissingmissing
2599Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003730__17600.07.200250[371, 133]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003730__176.json50.0missing{\n "num_gpu": 99\n}missing
2600Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003740__57900.09.222240[371, 184]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003740__579.json50.0missing{\n "num_gpu": 99\n}missing
2601Apple-MacBook-Pro-M1count_model_rowsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_221611__74500.09.225550[371, 184]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221611__745.json50.0missing{\n "num_gpu": 99\n}missing
2602Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralAsIs1SHOTfalsefalse520231213_233804__14300.013.77690[44, 416]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231213_233804__143.json0.0missingmissingmissing
2603Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralAsIs1SHOTfalsefalse520231224_234754__86200.03.869470[60, 120]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231224_234754__862.json0.0missing{\n "num_gpu": 99\n}missing
2604Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralAsIs1SHOTfalsefalse520231224_234758__14300.04.968940[60, 157]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231224_234758__143.json0.0missing{\n "num_gpu": 99\n}missing
2605Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruefalse520231213_233751__85000.013.84920[60, 416]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_233751__850.json25.0missingmissingmissing
2606Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruetrue520231224_234738__46110.05.869082[62, 188]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_234738__461.json80.0missing{\n "num_gpu": 99\n}missing
2607Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruetrue520231224_234750__67200.011.04880[62, 359]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231224_234750__672.json50.0missing{\n "num_gpu": 99\n}missing
2608Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralInJulia1SHOTtruetrue520231226_215558__28300.09.136740[62, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_215558__283.json50.0missing{\n "num_gpu": 99\n}missing
2609Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231213_233737__85400.05.212130[90, 148]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_233737__854.json50.0missingmissingmissing
2610Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231224_234726__34900.08.273240[104, 257]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_234726__349.json0.0missing{\n "num_gpu": 99\n}missing
2611Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231224_234732__53700.06.500690[104, 199]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231224_234732__537.json50.0missing{\n "num_gpu": 99\n}missing
2612Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_215549__58500.03.753570[104, 107]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_215549__585.json50.0missing{\n "num_gpu": 99\n}missing
2613Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231213_233731__33400.016.03440[201, 425]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233731__334.json50.0missingmissingmissing
2614Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231224_234701__99300.015.83520[215, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234701__993.json25.0missing{\n "num_gpu": 99\n}missing
2615Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231224_234717__72910.015.78531[215, 480]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234717__729.json67.5missing{\n "num_gpu": 99\n}missing
2616Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_215545__76600.018.63942[215, 403]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215545__766.json75.0missing{\n "num_gpu": 99\n}missing
2617Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231213_233838__79900.016.46170[11, 452]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_233838__799.json0.0missingmissingmissing
2618Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_234827__59300.08.453540[371, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234827__593.json50.0missing{\n "num_gpu": 99\n}missing
2619Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231224_234841__32210.013.87552[371, 389]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231224_234841__322.json80.0missing{\n "num_gpu": 99\n}missing
2620Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231226_215626__27500.06.394910[371, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215626__275.json50.0missing{\n "num_gpu": 99\n}missing
2621Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231213_233821__46600.016.90210[361, 383]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_233821__466.json50.0missingmissingmissing
2622Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231224_234809__99610.010.59461[369, 286]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_234809__996.json67.5missing{\n "num_gpu": 99\n}missing
2623Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231224_234818__90200.09.209940[369, 243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231224_234818__902.json50.0missing{\n "num_gpu": 99\n}missing
2624Apple-MacBook-Pro-M1count_model_rowsopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231226_215620__45400.021.18480[369, 610]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_215620__454.json25.0missing{\n "num_gpu": 99\n}missing
2625Apple-MacBook-Pro-M1count_model_rowsorca2:13bAsIs1SHOTfalsefalse520231213_234841__94700.014.45160[44, 437]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__AsIs__1SHOT__20231213_234841__947.json0.0missingmissingmissing
2626Apple-MacBook-Pro-M1count_model_rowsorca2:13bAsIs1SHOTfalsefalse520231225_001034__29400.031.27270[61, 571]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__AsIs__1SHOT__20231225_001034__294.json0.0missing{\n "num_gpu": 99\n}missing
2627Apple-MacBook-Pro-M1count_model_rowsorca2:13bAsIs1SHOTfalsefalse520231225_001048__13700.013.63290[61, 249]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__AsIs__1SHOT__20231225_001048__137.json0.0missing{\n "num_gpu": 99\n}missing
2628Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTtruefalse520231213_234827__61300.013.15330[60, 398]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231213_234827__613.json25.0missingmissingmissing
2629Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTfalsefalse520231225_001000__77400.018.82940[63, 346]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231225_001000__774.json0.0missing{\n "num_gpu": 99\n}missing
2630Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTfalsefalse520231225_001003__32800.02.847860[63, 44]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231225_001003__328.json0.0missing{\n "num_gpu": 99\n}missing
2631Apple-MacBook-Pro-M1count_model_rowsorca2:13bInJulia1SHOTfalsefalse520231226_220408__60500.024.48420[63, 451]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__InJulia__1SHOT__20231226_220408__605.json0.0missing{\n "num_gpu": 99\n}missing
2632Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTtruetrue520231213_234814__41800.05.967850[90, 172]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231213_234814__418.json50.0missingmissingmissing
2633Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_000929__44200.010.24840[103, 176]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_000929__442.json0.0missing{\n "num_gpu": 99\n}missing
2634Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_000941__64000.012.20040[103, 212]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_000941__640.json0.0missing{\n "num_gpu": 99\n}missing
2635Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_220344__81200.09.617630[103, 164]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_220344__812.json0.0missing{\n "num_gpu": 99\n}missing
2636Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231213_234808__33700.013.81620[201, 365]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234808__337.json50.0missingmissingmissing
2637Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_000853__19600.034.8770[214, 429]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000853__196.json0.0missing{\n "num_gpu": 99\n}missing
2638Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_000918__21800.025.49350[214, 435]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000918__218.json0.0missing{\n "num_gpu": 99\n}missing
2639Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_220334__98800.037.66270[214, 494]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220334__988.json0.0missing{\n "num_gpu": 99\n}missing
2640Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231213_234916__42700.014.6780[11, 406]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234916__427.json50.0missingmissingmissing
2641Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_001152__92200.027.75760[367, 442]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_001152__922.json0.0missing{\n "num_gpu": 99\n}missing
2642Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_001222__95110.030.19041[367, 484]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_001222__951.json67.5missing{\n "num_gpu": 99\n}missing
2643Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231226_220510__48600.042.63680[367, 696]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220510__486.json0.0missing{\n "num_gpu": 99\n}missing
2644Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTfalsefalse520231213_234901__64600.020.10890[361, 469]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231213_234901__646.json0.0missingmissingmissing
2645Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTtruetrue520231225_001102__59400.014.13290[364, 202]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_001102__594.json50.0missing{\n "num_gpu": 99\n}missing
2646Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_001124__45200.021.90110[364, 340]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_001124__452.json0.0missing{\n "num_gpu": 99\n}missing
2647Apple-MacBook-Pro-M1count_model_rowsorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_220427__66600.019.43660[364, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_220427__666.json0.0missing{\n "num_gpu": 99\n}missing
2648Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_220618__43400.015.23940[44, 460]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_220618__434.json0.0missingmissingmissing
2649Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_220631__81500.012.68090[1, 396]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_220631__815.json0.0missingmissingmissing
2650Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_220640__72300.08.74470[1, 279]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_220640__723.json0.0missingmissingmissing
2651Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_003920__67000.016.24820[51, 623]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_003920__670.json0.0missing{\n "num_gpu": 99\n}missing
2652Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_003935__82600.014.53750[51, 561]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_003935__826.json0.0missing{\n "num_gpu": 99\n}missing
2653Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTtruefalse520231219_220545__20100.018.84850[1, 571]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_220545__201.json25.0missingmissingmissing
2654Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_220603__79800.017.77430[1, 541]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_220603__798.json0.0missingmissingmissing
2655Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_003845__63500.00.8485940[54, 28]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_003845__635.json0.0missing{\n "num_gpu": 99\n}missing
2656Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_003904__70200.019.01770[54, 722]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_003904__702.json0.0missing{\n "num_gpu": 99\n}missing
2657Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231226_221654__79600.01.364340[54, 49]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_221654__796.json0.0missing{\n "num_gpu": 99\n}missing
2658Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_220501__36800.013.39850[1, 412]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_220501__368.json0.0missingmissingmissing
2659Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231219_220512__56200.011.27810[1, 350]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_220512__562.json50.0missingmissingmissing
2660Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_003843__88300.01.808960[91, 63]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_003843__883.json0.0missing{\n "num_gpu": 99\n}missing
2661Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_003844__29000.01.160570[91, 36]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_003844__290.json0.0missing{\n "num_gpu": 99\n}missing
2662Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_221653__79800.025.22280[91, 925]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_221653__798.json0.0missing{\n "num_gpu": 99\n}missing
2663Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231219_220427__28400.013.99890[1, 414]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220427__284.json50.0missingmissingmissing
2664Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_220438__32800.010.36010[1, 311]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220438__328.json25.0missingmissingmissing
2665Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_003826__75800.023.91410[199, 728]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003826__758.json0.0missing{\n "num_gpu": 99\n}missing
2666Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_003841__40100.015.15610[199, 550]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003841__401.json0.0missing{\n "num_gpu": 99\n}missing
2667Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_221627__98600.04.646060[199, 22]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221627__986.json0.0missing{\n "num_gpu": 99\n}missing
2668Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231219_220813__34100.021.47440[1, 587]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220813__341.json50.0missingmissingmissing
2669Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_220830__59800.016.98470[1, 473]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_220830__598.json25.0missingmissingmissing
2670Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_004013__52000.016.51710[343, 565]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004013__520.json0.0missing{\n "num_gpu": 99\n}missing
2671Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_004051__68500.037.49030[343, 1243]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004051__685.json0.0missing{\n "num_gpu": 99\n}missing
2672Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_221701__30400.01.773310[343, 26]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221701__304.json0.0missing{\n "num_gpu": 99\n}missing
2673Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_220716__11800.017.0380[1, 475]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_220716__118.json50.0missingmissingmissing
2674Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_220734__79100.017.31870[1, 482]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_220734__791.json50.0missingmissingmissing
2675Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_003939__57000.04.588150[340, 134]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_003939__570.json0.0missing{\n "num_gpu": 99\n}missing
2676Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_003957__54300.017.33810[340, 594]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_003957__543.json0.0missing{\n "num_gpu": 99\n}missing
2677Apple-MacBook-Pro-M1count_model_rowsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_221659__76000.05.006950[340, 150]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_221659__760.json0.0missing{\n "num_gpu": 99\n}missing
2678Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2AsIs1SHOTfalsefalse520231213_235005__23500.014.28320[44, 432]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231213_235005__235.json0.0missingmissingmissing
2679Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_001638__24800.041.4160[69, 320]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_001638__248.json0.0missing{\n "num_gpu": 99\n}missing
2680Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_001709__24400.031.91980[69, 244]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_001709__244.json0.0missing{\n "num_gpu": 99\n}missing
2681Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTtruetrue520231213_234951__78000.014.19140[60, 428]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231213_234951__780.json50.0missingmissingmissing
2682Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTfalsefalse520231225_001522__11400.037.27750[71, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_001522__114.json0.0missing{\n "num_gpu": 99\n}missing
2683Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_001556__11250.033.662[71, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_001556__112.json100.0missing{\n "num_gpu": 99\n}missing
2684Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2InJulia1SHOTfalsefalse520231226_220726__98300.039.43450[71, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_220726__983.json0.0missing{\n "num_gpu": 99\n}missing
2685Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231213_234937__77900.06.456240[90, 187]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231213_234937__779.json50.0missingmissingmissing
2686Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_001414__53950.020.34672[111, 145]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_001414__539.json100.0missing{\n "num_gpu": 99\n}missing
2687Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_001445__48110.031.24452[111, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_001445__481.json80.0missing{\n "num_gpu": 99\n}missing
2688Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_220647__75200.029.38220[111, 217]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_220647__752.json50.0missing{\n "num_gpu": 99\n}missing
2689Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231213_234930__40400.013.92180[201, 368]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234930__404.json50.0missingmissingmissing
2690Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231225_001300__29200.038.20290[222, 89]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_001300__292.json25.0missing{\n "num_gpu": 99\n}missing
2691Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231225_001353__89100.053.08550[222, 387]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_001353__891.json0.0missing{\n "num_gpu": 99\n}missing
2692Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231226_220617__83900.067.04740[222, 331]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220617__839.json25.0missing{\n "num_gpu": 99\n}missing
2693Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231213_235043__44100.018.33640[11, 502]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235043__441.json25.0missingmissingmissing
2694Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_001920__25400.029.76470[375, 175]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_001920__254.json50.0missing{\n "num_gpu": 99\n}missing
2695Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_002021__81650.060.90932[375, 416]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_002021__816.json100.0missing{\n "num_gpu": 99\n}missing
2696Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231226_220920__19700.046.05860[375, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220920__197.json25.0missing{\n "num_gpu": 99\n}missing
2697Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231213_235025__75800.019.48971[361, 453]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231213_235025__758.json62.5missingmissingmissing
2698Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231225_001758__85100.048.08350[372, 318]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_001758__851.json25.0missing{\n "num_gpu": 99\n}missing
2699Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_001850__65310.052.37592[372, 351]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_001850__653.json80.0missing{\n "num_gpu": 99\n}missing
2700Apple-MacBook-Pro-M1count_model_rowsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_220834__60950.067.68112[372, 468]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_220834__609.json100.0missing{\n "num_gpu": 99\n}missing
2701Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_215315__27700.010.72480[44, 328]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_215315__277.json0.0missingmissingmissing
2702Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_215325__15900.010.4020[1, 329]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_215325__159.json0.0missingmissingmissing
2703Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_215341__61700.015.96530[1, 491]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_215341__617.json0.0missingmissingmissing
2704Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_003301__22800.019.99230[62, 342]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_003301__228.json0.0missing{\n "num_gpu": 99\n}missing
2705Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_003313__34700.011.64740[62, 197]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_003313__347.json0.0missing{\n "num_gpu": 99\n}missing
2706Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_215250__84200.013.61830[1, 423]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_215250__842.json25.0missingmissingmissing
2707Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_215304__79100.014.37470[1, 445]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_215304__791.json0.0missingmissingmissing
2708Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231225_003223__89100.014.50140[64, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_003223__891.json0.0missing{\n "num_gpu": 99\n}missing
2709Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_003241__83000.017.48550[64, 299]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_003241__830.json50.0missing{\n "num_gpu": 99\n}missing
2710Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231226_221404__41110.018.77041[64, 321]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_221404__411.json67.5missing{\n "num_gpu": 99\n}missing
2711Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_215214__72500.06.506020[1, 207]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215214__725.json50.0missingmissingmissing
2712Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_215224__78100.09.680380[1, 303]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_215224__781.json50.0missingmissingmissing
2713Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_003155__19100.010.28210[106, 164]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003155__191.json50.0missing{\n "num_gpu": 99\n}missing
2714Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_003209__80900.013.47680[106, 220]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_003209__809.json0.0missing{\n "num_gpu": 99\n}missing
2715Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_221346__67000.017.33570[106, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_221346__670.json50.0missing{\n "num_gpu": 99\n}missing
2716Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_215149__67000.017.23880[1, 502]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215149__670.json50.0missingmissingmissing
2717Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_215200__64900.011.24590[1, 337]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_215200__649.json0.0missingmissingmissing
2718Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003125__39600.032.54780[217, 372]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003125__396.json50.0missing{\n "num_gpu": 99\n}missing
2719Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_003145__59300.019.6560[217, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_003145__593.json50.0missing{\n "num_gpu": 99\n}missing
2720Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_221328__22900.026.47030[217, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_221328__229.json0.0missing{\n "num_gpu": 99\n}missing
2721Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_215510__19210.017.11191[1, 476]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215510__192.json67.5missingmissingmissing
2722Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_215531__42300.021.02860[1, 576]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_215531__423.json25.0missingmissingmissing
2723Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_003410__81600.022.01890[373, 324]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003410__816.json0.0missing{\n "num_gpu": 99\n}missing
2724Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_003426__30900.015.88340[373, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_003426__309.json0.0missing{\n "num_gpu": 99\n}missing
2725Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231226_221435__79000.015.91670[373, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_221435__790.json0.0missing{\n "num_gpu": 99\n}missing
2726Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_215415__76800.014.95310[1, 420]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215415__768.json50.0missingmissingmissing
2727Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_215433__63100.017.54860[1, 488]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_215433__631.json50.0missingmissingmissing
2728Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003331__89000.018.06920[371, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003331__890.json50.0missing{\n "num_gpu": 99\n}missing
2729Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_003348__52300.017.05370[371, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_003348__523.json50.0missing{\n "num_gpu": 99\n}missing
2730Apple-MacBook-Pro-M1count_model_rowssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_221419__64700.014.91660[371, 205]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_221419__647.json50.0missing{\n "num_gpu": 99\n}missing
2731Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrAsIs1SHOTfalsefalse520231213_234717__17700.010.63120[44, 324]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__AsIs__1SHOT__20231213_234717__177.json0.0missingmissingmissing
2732Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrAsIs1SHOTfalsefalse520231225_000737__48300.03.891310[63, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_000737__483.json0.0missing{\n "num_gpu": 99\n}missing
2733Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrAsIs1SHOTfalsefalse520231225_000739__66400.01.999820[63, 113]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_000739__664.json0.0missing{\n "num_gpu": 99\n}missing
2734Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTfalsefalse520231213_234706__78100.017.94750[60, 535]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231213_234706__781.json0.0missingmissingmissing
2735Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTfalsefalse520231225_000727__54200.05.680330[66, 323]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_000727__542.json0.0missing{\n "num_gpu": 99\n}missing
2736Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTtruetrue520231225_000733__38600.06.239730[66, 355]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_000733__386.json50.0missing{\n "num_gpu": 99\n}missing
2737Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrInJulia1SHOTtruetrue520231226_220239__33100.04.962010[66, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_220239__331.json50.0missing{\n "num_gpu": 99\n}missing
2738Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231213_234648__51000.06.581831[90, 190]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231213_234648__510.json62.5missingmissingmissing
2739Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_000713__17100.03.224530[103, 176]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_000713__171.json0.0missing{\n "num_gpu": 99\n}missing
2740Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_000721__93100.08.220050[103, 454]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_000721__931.json0.0missing{\n "num_gpu": 99\n}missing
2741Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231226_220234__31700.02.720040[103, 146]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_220234__317.json25.0missing{\n "num_gpu": 99\n}missing
2742Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231213_234642__41900.014.36450[201, 380]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234642__419.json50.0missingmissingmissing
2743Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_000701__90400.012.66510[208, 509]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000701__904.json0.0missing{\n "num_gpu": 99\n}missing
2744Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_000710__87700.08.113930[208, 421]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_000710__877.json0.0missing{\n "num_gpu": 99\n}missing
2745Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_220232__56400.08.611710[208, 308]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_220232__564.json0.0missing{\n "num_gpu": 99\n}missing
2746Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231213_234754__88000.017.51330[11, 481]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234754__880.json25.0missingmissingmissing
2747Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_000807__90100.013.69640[353, 651]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000807__901.json0.0missing{\n "num_gpu": 99\n}missing
2748Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_000818__19600.011.17660[353, 530]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000818__196.json25.0missing{\n "num_gpu": 99\n}missing
2749Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231226_220256__48800.07.170560[353, 330]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220256__488.json0.0missing{\n "num_gpu": 99\n}missing
2750Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231213_234736__91900.019.02380[361, 441]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231213_234736__919.json50.0missingmissingmissing
2751Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_000745__52400.06.110280[351, 279]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_000745__524.json50.0missing{\n "num_gpu": 99\n}missing
2752Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_000753__14300.07.9290[351, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_000753__143.json0.0missing{\n "num_gpu": 99\n}missing
2753Apple-MacBook-Pro-M1count_model_rowsstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_220249__45500.09.122190[351, 432]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_220249__455.json50.0missing{\n "num_gpu": 99\n}missing
2754Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestAsIs1SHOTfalsefalse520231213_233927__43200.010.86350[44, 330]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__AsIs__1SHOT__20231213_233927__432.json0.0missingmissingmissing
2755Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestAsIs1SHOTfalsefalse520231224_234949__71600.05.297340[61, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__AsIs__1SHOT__20231224_234949__716.json0.0missing{\n "num_gpu": 99\n}missing
2756Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestAsIs1SHOTfalsefalse520231224_234954__91100.05.716850[61, 182]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__AsIs__1SHOT__20231224_234954__911.json0.0missing{\n "num_gpu": 99\n}missing
2757Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTfalsefalse520231213_233916__21900.09.821090[60, 297]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_233916__219.json0.0missingmissingmissing
2758Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTtruetrue520231224_234934__59410.07.268651[64, 234]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_234934__594.json67.5missing{\n "num_gpu": 99\n}missing
2759Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTtruetrue520231224_234943__16110.08.849931[64, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231224_234943__161.json67.5missing{\n "num_gpu": 99\n}missing
2760Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestInJulia1SHOTtruetrue520231226_215713__31210.014.65761[64, 476]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_215713__312.json67.5missing{\n "num_gpu": 99\n}missing
2761Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231213_233907__14100.08.931960[90, 261]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_233907__141.json50.0missingmissingmissing
2762Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_234923__56200.05.871220[106, 178]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_234923__562.json50.0missing{\n "num_gpu": 99\n}missing
2763Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231224_234927__17400.04.150570[106, 120]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231224_234927__174.json50.0missing{\n "num_gpu": 99\n}missing
2764Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_215658__74610.012.11752[106, 383]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_215658__746.json80.0missing{\n "num_gpu": 99\n}missing
2765Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231213_233858__37500.019.6720[201, 523]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_233858__375.json0.0missingmissingmissing
2766Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231224_234901__19210.020.47371[217, 450]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234901__192.json67.5missing{\n "num_gpu": 99\n}missing
2767Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231224_234917__61400.015.28630[217, 463]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231224_234917__614.json0.0missing{\n "num_gpu": 99\n}missing
2768Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231226_215646__17500.019.5770[217, 438]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215646__175.json0.0missing{\n "num_gpu": 99\n}missing
2769Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231213_234001__33810.012.05081[11, 316]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234001__338.json67.5missingmissingmissing
2770Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231224_235037__55000.07.941650[373, 201]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_235037__550.json0.0missing{\n "num_gpu": 99\n}missing
2771Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231224_235105__16600.027.86190[373, 806]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231224_235105__166.json0.0missing{\n "num_gpu": 99\n}missing
2772Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_215729__67700.08.530790[373, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_215729__677.json50.0missing{\n "num_gpu": 99\n}missing
2773Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231213_233948__18000.021.12160[361, 491]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_233948__180.json50.0missingmissingmissing
2774Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_235015__43000.020.98470[371, 604]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_235015__430.json50.0missing{\n "num_gpu": 99\n}missing
2775Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231224_235029__84200.013.31960[371, 371]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231224_235029__842.json50.0missing{\n "num_gpu": 99\n}missing
2776Apple-MacBook-Pro-M1count_model_rowsstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_215721__94210.07.733761[371, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_215721__942.json67.5missing{\n "num_gpu": 99\n}missing
2777Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatAsIs1SHOTfalsefalse520231213_234044__14500.09.686110[44, 295]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__AsIs__1SHOT__20231213_234044__145.json0.0missingmissingmissing
2778Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatAsIs1SHOTfalsefalse520231224_235630__42000.056.49850[58, 430]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__AsIs__1SHOT__20231224_235630__420.json0.0missing{\n "num_gpu": 99\n}missing
2779Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatAsIs1SHOTfalsefalse520231224_235704__58600.034.47610[58, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__AsIs__1SHOT__20231224_235704__586.json0.0missing{\n "num_gpu": 99\n}missing
2780Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruefalse520231213_234035__39500.015.55520[60, 467]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_234035__395.json25.0missingmissingmissing
2781Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruefalse520231224_235418__52100.045.77270[61, 348]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_235418__521.json25.0missing{\n "num_gpu": 99\n}missing
2782Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruetrue520231224_235533__13510.075.17382[61, 570]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231224_235533__135.json80.0missing{\n "num_gpu": 99\n}missing
2783Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatInJulia1SHOTtruefalse520231226_215927__91700.044.84180[61, 342]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_215927__917.json25.0missing{\n "num_gpu": 99\n}missing
2784Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231213_234019__56900.02.38510[90, 57]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_234019__569.json0.0missingmissingmissing
2785Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231224_235303__94700.020.10160[100, 138]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_235303__947.json50.0missing{\n "num_gpu": 99\n}missing
2786Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231224_235332__97900.028.91810[100, 207]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231224_235332__979.json50.0missing{\n "num_gpu": 99\n}missing
2787Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_215842__31700.031.33830[100, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_215842__317.json50.0missing{\n "num_gpu": 99\n}missing
2788Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231213_234017__22400.016.00190[201, 424]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_234017__224.json50.0missingmissingmissing
2789Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231224_235155__92100.050.60810[211, 167]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_235155__921.json25.0missing{\n "num_gpu": 99\n}missing
2790Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231224_235243__24910.047.14632[211, 328]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231224_235243__249.json80.0missing{\n "num_gpu": 99\n}missing
2791Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231226_215811__59000.041.26270[211, 109]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_215811__590.json25.0missing{\n "num_gpu": 99\n}missing
2792Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231213_234126__38200.021.25960[11, 574]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_234126__382.json50.0missingmissingmissing
2793Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_000004__41200.073.36340[374, 488]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000004__412.json25.0missing{\n "num_gpu": 99\n}missing
2794Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_000043__37000.039.11170[374, 237]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_000043__370.json25.0missing{\n "num_gpu": 99\n}missing
2795Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231226_220035__33700.014.42880[374, 51]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_220035__337.json0.0missing{\n "num_gpu": 99\n}missing
2796Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruetrue520231213_234105__32100.020.18890[361, 470]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_234105__321.json50.0missingmissingmissing
2797Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_235741__83700.036.54120[372, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_235741__837.json25.0missing{\n "num_gpu": 99\n}missing
2798Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruefalse520231224_235850__98700.069.6420[372, 462]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231224_235850__987.json25.0missing{\n "num_gpu": 99\n}missing
2799Apple-MacBook-Pro-M1count_model_rowsyi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_220021__78410.053.81361[372, 348]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/count_model_rows/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_220021__784.json67.5missing{\n "num_gpu": 99\n}missing
2800Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructAsIs1SHOTfalsefalse520231214_000100__81100.026.2350[138, 721]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_000100__811.json0.0missingmissingmissing
2801Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructAsIs1SHOTtruetrue520231225_010756__54900.022.58830[160, 397]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_010756__549.json50.0missing{\n "num_gpu": 99\n}missing
2802Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructAsIs1SHOTfalsefalse520231225_010821__14100.024.46560[160, 431]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_010821__141.json0.0missing{\n "num_gpu": 99\n}missing
2803Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTfalsefalse520231214_000034__40100.024.54380[155, 675]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_000034__401.json0.0missingmissingmissing
2804Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruetrue520231225_010714__31300.023.45610[163, 408]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_010714__313.json50.0missing{\n "num_gpu": 99\n}missing
2805Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruetrue520231225_010733__63200.019.49320[163, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_010733__632.json50.0missing{\n "num_gpu": 99\n}missing
2806Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructInJulia1SHOTtruetrue520231226_223025__59440.027.17544[163, 477]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_223025__594.json90.0missing{\n "num_gpu": 99\n}missing
2807Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231214_000009__47900.015.50250[184, 420]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_000009__479.json0.0missingmissingmissing
2808Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_010632__63220.019.08823[201, 323]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_010632__632.json75.0missing{\n "num_gpu": 99\n}missing
2809Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_010650__12720.018.15043[201, 306]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_010650__127.json75.0missing{\n "num_gpu": 99\n}missing
2810Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_222958__80020.019.77784[201, 337]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_222958__800.json80.0missing{\n "num_gpu": 99\n}missing
2811Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231213_235953__95100.013.07690[280, 315]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235953__951.json25.0missingmissingmissing
2812Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_010554__10120.037.76643[298, 458]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_010554__101.json75.0missing{\n "num_gpu": 99\n}missing
2813Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_010613__60620.018.43113[298, 292]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_010613__606.json75.0missing{\n "num_gpu": 99\n}missing
2814Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_222938__20300.024.87980[298, 230]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222938__203.json0.0missing{\n "num_gpu": 99\n}missing
2815Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231214_000141__76000.025.90640[11, 673]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000141__760.json0.0missingmissingmissing
2816Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_010926__88510.025.67684[466, 388]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010926__885.json75.0missing{\n "num_gpu": 99\n}missing
2817Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_010955__45500.028.70180[466, 440]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010955__455.json50.0missing{\n "num_gpu": 99\n}missing
2818Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231226_223123__49500.031.01970[466, 481]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223123__495.json0.0missing{\n "num_gpu": 99\n}missing
2819Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_000115__90200.014.91840[455, 288]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_000115__902.json0.0missingmissingmissing
2820Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_010836__79600.015.29390[463, 207]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_010836__796.json50.0missing{\n "num_gpu": 99\n}missing
2821Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_010901__17720.024.62065[463, 370]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_010901__177.json85.0missing{\n "num_gpu": 99\n}missing
2822Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_223052__45120.026.44614[463, 403]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_223052__451.json80.0missing{\n "num_gpu": 99\n}missing
2823NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230552__61540.03.186395[0, 240]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230552__615.json95.0missing{\n "num_gpu": 99\n}missing
2824NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230555__60900.02.915330[0, 220]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230555__609.json50.0missing{\n "num_gpu": 99\n}missing
2825NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230600__93100.04.112883[0, 309]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230600__931.json65.0missing{\n "num_gpu": 99\n}missing
2826NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230604__68200.03.980320[0, 299]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230604__682.json50.0missing{\n "num_gpu": 99\n}missing
2827NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230608__42940.04.150925[0, 310]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230608__429.json95.0missing{\n "num_gpu": 99\n}missing
2828NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230515__52620.01.962064[0, 148]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230515__526.json80.0missing{\n "num_gpu": 99\n}missing
2829NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230518__95500.03.082790[0, 232]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230518__955.json50.0missing{\n "num_gpu": 99\n}missing
2830NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230523__13320.04.015533[0, 301]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230523__133.json75.0missing{\n "num_gpu": 99\n}missing
2831NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230525__90200.02.096350[0, 158]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230525__902.json50.0missing{\n "num_gpu": 99\n}missing
2832NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230527__29220.02.228094[0, 168]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230527__292.json80.0missing{\n "num_gpu": 99\n}missing
2833NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230438__50620.04.68393[0, 345]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230438__506.json75.0missing{\n "num_gpu": 99\n}missing
2834NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230442__54810.04.480511[0, 327]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230442__548.json60.0missing{\n "num_gpu": 99\n}missing
2835NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230447__25010.04.258641[0, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230447__250.json60.0missing{\n "num_gpu": 99\n}missing
2836NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230451__16420.03.655393[0, 268]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230451__164.json75.0missing{\n "num_gpu": 99\n}missing
2837NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230456__27220.05.390962[0, 393]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230456__272.json70.0missing{\n "num_gpu": 99\n}missing
2838NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_230732__78600.06.072610[0, 437]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230732__786.json50.0missing{\n "num_gpu": 99\n}missing
2839NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_230738__96500.06.223450[0, 442]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230738__965.json50.0missing{\n "num_gpu": 99\n}missing
2840NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_230743__82930.05.406134[0, 390]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230743__829.json85.0missing{\n "num_gpu": 99\n}missing
2841NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_230749__60800.04.999310[0, 364]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230749__608.json50.0missing{\n "num_gpu": 99\n}missing
2842NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_230754__66430.05.267435[0, 383]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230754__664.json90.0missing{\n "num_gpu": 99\n}missing
2843NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230632__39200.03.289080[0, 240]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230632__392.json50.0missing{\n "num_gpu": 99\n}missing
2844NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230637__94600.04.847250[0, 353]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230637__946.json50.0missing{\n "num_gpu": 99\n}missing
2845NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230642__77900.05.100220[0, 371]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230642__779.json50.0missing{\n "num_gpu": 99\n}missing
2846NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230647__21020.04.443514[0, 324]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230647__210.json80.0missing{\n "num_gpu": 99\n}missing
2847NVIDIA-RTX-4090-4xweather_data_analyzercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230653__88300.06.599210[0, 476]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230653__883.json50.0missing{\n "num_gpu": 99\n}missing
2848Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonAsIs1SHOTfalsefalse520231214_000306__96800.017.49780[138, 489]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_000306__968.json0.0missingmissingmissing
2849Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonAsIs1SHOTfalsefalse520231225_011141__37000.021.69530[134, 383]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_011141__370.json0.0missing{\n "num_gpu": 99\n}missing
2850Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonAsIs1SHOTfalsefalse520231225_011150__19000.09.188180[134, 151]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_011150__190.json0.0missing{\n "num_gpu": 99\n}missing
2851Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonInJulia1SHOTtruetrue520231214_000248__51700.025.25630[155, 693]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_000248__517.json50.0missingmissingmissing
2852Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_011051__68700.08.505580[137, 138]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_011051__687.json0.0missing{\n "num_gpu": 99\n}missing
2853Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_011119__71000.028.51890[137, 506]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_011119__710.json0.0missing{\n "num_gpu": 99\n}missing
2854Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_000223__42100.019.21960[184, 521]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_000223__421.json0.0missingmissingmissing
2855Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_011028__91100.09.835380[138, 163]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_011028__911.json0.0missing{\n "num_gpu": 99\n}missing
2856Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231225_011042__30800.014.37570[138, 248]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_011042__308.json50.0missing{\n "num_gpu": 99\n}missing
2857Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_000204__55200.023.09830[280, 582]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000204__552.json50.0missingmissingmissing
2858Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_011012__58700.016.83070[173, 97]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011012__587.json0.0missing{\n "num_gpu": 99\n}missing
2859Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_011018__22500.05.96430[173, 84]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011018__225.json0.0missing{\n "num_gpu": 99\n}missing
2860Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_000403__46000.027.57075[11, 712]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000403__460.json75.0missingmissingmissing
2861Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231225_011222__61400.013.72060[155, 235]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011222__614.json25.0missing{\n "num_gpu": 99\n}missing
2862Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_011224__15000.01.830380[155, 10]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011224__150.json0.0missing{\n "num_gpu": 99\n}missing
2863Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231214_000336__92200.029.64475[455, 660]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_000336__922.json75.0missingmissingmissing
2864Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231225_011157__31000.06.320420[152, 96]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_011157__310.json50.0missing{\n "num_gpu": 99\n}missing
2865Apple-MacBook-Pro-M1weather_data_analyzercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_011209__85100.011.9950[152, 203]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_011209__851.json0.0missing{\n "num_gpu": 99\n}missing
2866NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_231551__78600.010.39040[0, 374]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_231551__786.json50.0missing{\n "num_gpu": 99\n}missing
2867NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_231605__51400.013.150[0, 469]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_231605__514.json0.0missing{\n "num_gpu": 99\n}missing
2868NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_231615__53350.09.844615[0, 352]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_231615__533.json100.0missing{\n "num_gpu": 99\n}missing
2869NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_231632__20610.017.00044[0, 606]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_231632__206.json75.0missing{\n "num_gpu": 99\n}missing
2870NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_231643__66640.011.37234[0, 408]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_231643__666.json90.0missing{\n "num_gpu": 99\n}missing
2871NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_231357__19400.014.09950[0, 502]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_231357__194.json50.0missing{\n "num_gpu": 99\n}missing
2872NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_231409__77720.011.39933[0, 407]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_231409__777.json75.0missing{\n "num_gpu": 99\n}missing
2873NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_231418__82400.09.370180[0, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_231418__824.json50.0missing{\n "num_gpu": 99\n}missing
2874NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_231424__19020.05.338654[0, 192]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_231424__190.json80.0missing{\n "num_gpu": 99\n}missing
2875NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240131_231435__86200.011.22360[0, 402]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_231435__862.json25.0missing{\n "num_gpu": 99\n}missing
2876NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_231208__77800.06.277450[0, 225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_231208__778.json0.0missing{\n "num_gpu": 99\n}missing
2877NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_231220__18930.012.32915[0, 438]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_231220__189.json90.0missing{\n "num_gpu": 99\n}missing
2878NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_231230__34920.09.408344[0, 332]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_231230__349.json80.0missing{\n "num_gpu": 99\n}missing
2879NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_231245__29900.014.84850[0, 522]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_231245__299.json50.0missing{\n "num_gpu": 99\n}missing
2880NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_231253__16440.07.689564[0, 273]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_231253__164.json90.0missing{\n "num_gpu": 99\n}missing
2881NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_231912__71800.017.54520[0, 621]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231912__718.json0.0missing{\n "num_gpu": 99\n}missing
2882NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_231938__24530.026.01645[0, 920]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231938__245.json90.0missing{\n "num_gpu": 99\n}missing
2883NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_231943__39940.05.126874[0, 182]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231943__399.json90.0missing{\n "num_gpu": 99\n}missing
2884NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_231944__14300.00.1430660[0, 5]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231944__143.json0.0missing{\n "num_gpu": 99\n}missing
2885NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_231944__64100.00.1433020[0, 5]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231944__641.json0.0missing{\n "num_gpu": 99\n}missing
2886NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_231735__98540.06.124494[0, 217]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_231735__985.json90.0missing{\n "num_gpu": 99\n}missing
2887NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_231742__16600.06.253160[0, 222]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_231742__166.json0.0missing{\n "num_gpu": 99\n}missing
2888NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_231759__66300.017.31330[0, 612]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_231759__663.json50.0missing{\n "num_gpu": 99\n}missing
2889NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_231808__27350.08.374345[0, 295]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_231808__273.json100.0missing{\n "num_gpu": 99\n}missing
2890NVIDIA-RTX-4090-4xweather_data_analyzercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_231815__36130.06.945334[0, 246]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_231815__361.json85.0missing{\n "num_gpu": 99\n}missing
2891NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_225554__67600.023.04795[0, 560]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_225554__676.json75.0missing{\n "num_gpu": 99\n}missing
2892NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_225559__10700.05.175990[0, 127]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_225559__107.json0.0missing{\n "num_gpu": 99\n}missing
2893NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_225618__76300.018.70341[0, 456]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_225618__763.json55.0missing{\n "num_gpu": 99\n}missing
2894NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240131_225639__26030.021.0795[0, 513]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_225639__260.json90.0missing{\n "num_gpu": 99\n}missing
2895NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240131_225708__62200.029.12090[0, 706]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_225708__622.json0.0missing{\n "num_gpu": 99\n}missing
2896NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_225402__14700.022.05970[0, 535]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_225402__147.json0.0missing{\n "num_gpu": 99\n}missing
2897NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_225408__68600.05.867370[0, 143]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_225408__686.json0.0missing{\n "num_gpu": 99\n}missing
2898NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_225417__54000.09.208720[0, 225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_225417__540.json0.0missing{\n "num_gpu": 99\n}missing
2899NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_225426__56200.08.793140[0, 215]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_225426__562.json0.0missing{\n "num_gpu": 99\n}missing
2900NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_225441__11200.015.36470[0, 375]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_225441__112.json0.0missing{\n "num_gpu": 99\n}missing
2901NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_225100__92520.023.43213[0, 567]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_225100__925.json75.0missing{\n "num_gpu": 99\n}missing
2902NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_225129__44540.028.95355[0, 700]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_225129__445.json95.0missing{\n "num_gpu": 99\n}missing
2903NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_225139__63400.010.05270[0, 245]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_225139__634.json0.0missing{\n "num_gpu": 99\n}missing
2904NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_225146__15600.07.429060[0, 181]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_225146__156.json0.0missing{\n "num_gpu": 99\n}missing
2905NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_225201__28640.014.57175[0, 352]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_225201__286.json95.0missing{\n "num_gpu": 99\n}missing
2906NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_230218__43610.026.30945[0, 632]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230218__436.json80.0missing{\n "num_gpu": 99\n}missing
2907NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_230251__54910.033.32924[0, 799]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230251__549.json75.0missing{\n "num_gpu": 99\n}missing
2908NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240131_230259__32000.08.049280[0, 193]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230259__320.json0.0missing{\n "num_gpu": 99\n}missing
2909NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_230327__80730.028.12385[0, 675]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230327__807.json90.0missing{\n "num_gpu": 99\n}missing
2910NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240131_230406__84030.038.60264[0, 925]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_230406__840.json85.0missing{\n "num_gpu": 99\n}missing
2911NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_225913__67120.022.50494[0, 540]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_225913__671.json80.0missing{\n "num_gpu": 99\n}missing
2912NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_225926__75840.012.50615[0, 301]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_225926__758.json95.0missing{\n "num_gpu": 99\n}missing
2913NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240131_225942__52400.015.51820[0, 373]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_225942__524.json0.0missing{\n "num_gpu": 99\n}missing
2914NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240131_225943__76700.00.7899590[0, 19]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_225943__767.json0.0missing{\n "num_gpu": 99\n}missing
2915NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240131_230034__15440.051.15875[0, 1225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_230034__154.json95.0missing{\n "num_gpu": 99\n}missing
2916NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_223533__62400.05.364650[0, 100]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_223533__624.json0.0missing{\n "num_gpu": 99\n}missing
2917NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_223548__19600.014.70880[0, 275]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_223548__196.json0.0missing{\n "num_gpu": 99\n}missing
2918NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_223614__69140.026.45375[0, 492]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_223614__691.json95.0missing{\n "num_gpu": 99\n}missing
2919NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_223627__67700.012.03210[0, 224]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_223627__677.json0.0missing{\n "num_gpu": 99\n}missing
2920NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_223649__36550.022.70985[0, 421]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_223649__365.json100.0missing{\n "num_gpu": 99\n}missing
2921NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_223244__54300.010.56240[0, 197]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_223244__543.json0.0missing{\n "num_gpu": 99\n}missing
2922NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_223306__22040.021.93295[0, 408]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_223306__220.json95.0missing{\n "num_gpu": 99\n}missing
2923NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_223318__86500.012.1010[0, 225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_223318__865.json0.0missing{\n "num_gpu": 99\n}missing
2924NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_223331__25500.012.78754[0, 238]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_223331__255.json70.0missing{\n "num_gpu": 99\n}missing
2925NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_223402__77400.030.42450[0, 564]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_223402__774.json0.0missing{\n "num_gpu": 99\n}missing
2926NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_222941__21900.031.14920[0, 574]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_222941__219.json0.0missing{\n "num_gpu": 99\n}missing
2927NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_223003__98040.022.85825[0, 422]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_223003__980.json95.0missing{\n "num_gpu": 99\n}missing
2928NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_223028__79440.023.94585[0, 442]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_223028__794.json95.0missing{\n "num_gpu": 99\n}missing
2929NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_223048__52800.018.49390[0, 342]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_223048__528.json50.0missing{\n "num_gpu": 99\n}missing
2930NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_223106__24700.018.08440[0, 335]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_223106__247.json0.0missing{\n "num_gpu": 99\n}missing
2931NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_224600__73200.025.44570[0, 467]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_224600__732.json50.0missing{\n "num_gpu": 99\n}missing
2932NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_224621__47600.020.72960[0, 381]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_224621__476.json0.0missing{\n "num_gpu": 99\n}missing
2933NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_224639__12300.017.99070[0, 330]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_224639__123.json0.0missing{\n "num_gpu": 99\n}missing
2934NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_224830__97300.0111.4650[0, 2027]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_224830__973.json0.0missing{\n "num_gpu": 99\n}missing
2935NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_224852__66200.021.65830[471, 389]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_224852__662.json0.0missing{\n "num_gpu": 99\n}missing
2936NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_223932__65410.023.72691[0, 435]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_223932__654.json60.0missing{\n "num_gpu": 99\n}missing
2937NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240131_224041__97100.069.23110[0, 1264]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_224041__971.json25.0missing{\n "num_gpu": 99\n}missing
2938NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_224106__34500.024.9830[0, 455]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_224106__345.json0.0missing{\n "num_gpu": 99\n}missing
2939NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240131_224153__14500.046.9220[0, 855]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_224153__145.json0.0missing{\n "num_gpu": 99\n}missing
2940NVIDIA-RTX-4090-4xweather_data_analyzercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_224222__18330.028.6985[0, 527]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_224222__183.json90.0missing{\n "num_gpu": 99\n}missing
2941NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230911__93720.03.150615[0, 379]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230911__937.json85.0missing{\n "num_gpu": 99\n}missing
2942NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230914__73410.02.205751[0, 266]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230914__734.json60.0missing{\n "num_gpu": 99\n}missing
2943NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230917__85630.02.938495[0, 354]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230917__856.json90.0missing{\n "num_gpu": 99\n}missing
2944NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230919__41720.02.551795[0, 308]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230919__417.json85.0missing{\n "num_gpu": 99\n}missing
2945NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_230922__62220.02.062425[0, 248]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_230922__622.json85.0missing{\n "num_gpu": 99\n}missing
2946NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230841__68920.01.441353[0, 166]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230841__689.json75.0missing{\n "num_gpu": 99\n}missing
2947NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230843__29130.02.344555[0, 274]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230843__291.json90.0missing{\n "num_gpu": 99\n}missing
2948NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230847__85730.03.232615[0, 380]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230847__857.json90.0missing{\n "num_gpu": 99\n}missing
2949NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230849__44130.01.755955[0, 212]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230849__441.json90.0missing{\n "num_gpu": 99\n}missing
2950NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_230851__26610.02.366821[0, 285]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_230851__266.json60.0missing{\n "num_gpu": 99\n}missing
2951NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230817__58220.03.487135[0, 414]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230817__582.json85.0missing{\n "num_gpu": 99\n}missing
2952NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230819__80520.01.750255[0, 210]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230819__805.json85.0missing{\n "num_gpu": 99\n}missing
2953NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230822__50620.02.833125[0, 337]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230822__506.json85.0missing{\n "num_gpu": 99\n}missing
2954NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230824__75910.01.785971[0, 214]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230824__759.json60.0missing{\n "num_gpu": 99\n}missing
2955NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240131_230826__87030.02.439145[0, 291]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_230826__870.json90.0missing{\n "num_gpu": 99\n}missing
2956NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_231020__89700.07.745190[0, 885]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231020__897.json50.0missing{\n "num_gpu": 99\n}missing
2957NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_231022__86320.02.698135[0, 316]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231022__863.json85.0missing{\n "num_gpu": 99\n}missing
2958NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_231028__97840.05.40945[0, 627]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231028__978.json95.0missing{\n "num_gpu": 99\n}missing
2959NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_231031__62010.02.664871[0, 310]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231031__620.json60.0missing{\n "num_gpu": 99\n}missing
2960NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240131_231035__96900.04.544870[0, 528]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_231035__969.json0.0missing{\n "num_gpu": 99\n}missing
2961NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230938__84910.02.081071[0, 233]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230938__849.json60.0missing{\n "num_gpu": 99\n}missing
2962NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230943__24200.04.91410[0, 559]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230943__242.json50.0missing{\n "num_gpu": 99\n}missing
2963NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230946__70440.03.36545[0, 387]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230946__704.json95.0missing{\n "num_gpu": 99\n}missing
2964NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230951__86120.04.130675[0, 470]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230951__861.json85.0missing{\n "num_gpu": 99\n}missing
2965NVIDIA-RTX-4090-4xweather_data_analyzercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_230954__37710.03.832253[0, 434]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_230954__377.json70.0missing{\n "num_gpu": 99\n}missing
2966Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_221220__14400.024.3420[138, 674]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_221220__144.json0.0missingmissingmissing
2967Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_221246__37100.025.55740[1, 731]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_221246__371.json0.0missingmissingmissing
2968Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_221306__29300.020.07930[1, 588]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_221306__293.json0.0missingmissingmissing
2969Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruefalse520231225_014003__95600.0102.2880[160, 604]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_014003__956.json25.0missing{\n "num_gpu": 99\n}missing
2970Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue520231225_014050__78340.046.46154[160, 267]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_014050__783.json90.0missing{\n "num_gpu": 99\n}missing
2971Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231219_221134__94110.028.34441[1, 801]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_221134__941.json60.0missingmissingmissing
2972Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_221156__76400.022.18110[1, 643]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_221156__764.json0.0missingmissingmissing
2973Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_013715__31120.076.7083[163, 446]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_013715__311.json75.0missing{\n "num_gpu": 99\n}missing
2974Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_013820__73520.064.52193[163, 373]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_013820__735.json75.0missing{\n "num_gpu": 99\n}missing
2975Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_224506__86040.061.81665[163, 358]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_224506__860.json95.0missing{\n "num_gpu": 99\n}missing
2976Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_221035__97000.019.83040[1, 574]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221035__970.json50.0missingmissingmissing
2977Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_221047__53000.012.71034[1, 380]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221047__530.json70.0missingmissingmissing
2978Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_013454__63320.048.03125[204, 266]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_013454__633.json85.0missing{\n "num_gpu": 99\n}missing
2979Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_013558__93840.063.42255[204, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_013558__938.json95.0missing{\n "num_gpu": 99\n}missing
2980Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_224403__93700.070.04143[204, 401]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_224403__937.json65.0missing{\n "num_gpu": 99\n}missing
2981Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_220931__30210.032.16391[1, 862]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220931__302.json60.0missingmissingmissing
2982Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_220959__91310.027.88321[1, 760]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_220959__913.json60.0missingmissingmissing
2983Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_013307__76800.099.76985[299, 391]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_013307__768.json75.0missing{\n "num_gpu": 99\n}missing
2984Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_013406__96410.058.50011[299, 313]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_013406__964.json60.0missing{\n "num_gpu": 99\n}missing
2985Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_224253__45400.0101.6995[299, 434]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_224253__454.json75.0missing{\n "num_gpu": 99\n}missing
2986Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_221525__24100.024.05770[1, 635]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_221525__241.json0.0missingmissingmissing
2987Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_221601__25700.036.31650[1, 919]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_221601__257.json50.0missingmissingmissing
2988Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_014431__54600.064.52480[492, 314]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_014431__546.json50.0missing{\n "num_gpu": 99\n}missing
2989Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_014547__60500.075.08920[492, 376]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_014547__605.json50.0missing{\n "num_gpu": 99\n}missing
2990Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_224808__42640.079.42195[492, 403]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_224808__426.json95.0missing{\n "num_gpu": 99\n}missing
2991Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_221412__64300.011.21380[1, 311]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_221412__643.json0.0missingmissingmissing
2992Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231219_221436__32300.024.86540[1, 655]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_221436__323.json25.0missingmissingmissing
2993Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_014210__19800.078.92520[490, 394]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014210__198.json50.0missing{\n "num_gpu": 99\n}missing
2994Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_014326__61130.075.40094[490, 378]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014326__611.json85.0missing{\n "num_gpu": 99\n}missing
2995Apple-MacBook-Pro-M1weather_data_analyzerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_224648__51000.0101.8474[490, 534]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_224648__510.json70.0missing{\n "num_gpu": 99\n}missing
2996Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231226_225705__39900.010.72130[156, 398]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_225705__399.json0.0missing{\n "num_gpu": 99\n}missing
2997Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_104415__88400.014.12650[156, 522]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_104415__884.json0.0missing{\n "num_gpu": 99\n}missing
2998Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_104431__81000.015.92380[156, 587]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_104431__810.json0.0missing{\n "num_gpu": 99\n}missing
2999Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_104529__73500.058.07080[156, 1904]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_104529__735.json0.0missing{\n "num_gpu": 99\n}missing
3000Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_225654__50500.010.02860[193, 363]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_225654__505.json0.0missing{\n "num_gpu": 99\n}missing
3001Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_104348__70600.08.953640[193, 323]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_104348__706.json0.0missing{\n "num_gpu": 99\n}missing
3002Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_104356__34800.07.535890[193, 269]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_104356__348.json0.0missing{\n "num_gpu": 99\n}missing
3003Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_104401__48500.05.21680[193, 181]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_104401__485.json0.0missing{\n "num_gpu": 99\n}missing
3004Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_225644__40300.010.28090[277, 230]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225644__403.json0.0missing{\n "num_gpu": 99\n}missing
3005Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_104325__36100.015.1580[277, 406]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104325__361.json0.0missing{\n "num_gpu": 99\n}missing
3006Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_104330__50200.04.856950[277, 155]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104330__502.json0.0missing{\n "num_gpu": 99\n}missing
3007Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_104339__87000.09.729860[277, 337]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104339__870.json0.0missing{\n "num_gpu": 99\n}missing
3008Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_225723__34900.07.115060[445, 209]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225723__349.json0.0missing{\n "num_gpu": 99\n}missing
3009Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_104605__76100.05.719870[445, 158]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104605__761.json0.0missing{\n "num_gpu": 99\n}missing
3010Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_104616__17900.010.75180[445, 339]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104616__179.json0.0missing{\n "num_gpu": 99\n}missing
3011Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_104625__90800.08.865370[445, 272]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_104625__908.json25.0missing{\n "num_gpu": 99\n}missing
3012Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231226_225715__37300.010.45320[442, 329]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_225715__373.json0.0missing{\n "num_gpu": 99\n}missing
3013Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_104539__73700.09.622270[442, 299]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_104539__737.json0.0missing{\n "num_gpu": 99\n}missing
3014Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_104549__77900.010.11830[442, 317]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_104549__779.json0.0missing{\n "num_gpu": 99\n}missing
3015Apple-MacBook-Pro-M1weather_data_analyzerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_104559__63700.010.47920[442, 330]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_104559__637.json0.0missing{\n "num_gpu": 99\n}missing
3016Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_105210__42700.03.964870[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105210__427.json50.0missingmissingmissing
3017Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_105214__31600.03.988410[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105214__316.json25.0missingmissingmissing
3018Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_105219__74700.05.134390[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105219__747.json50.0missingmissingmissing
3019Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_105224__15600.04.666990[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105224__156.json0.0missingmissingmissing
3020Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_105228__74100.04.184830[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105228__741.json25.0missingmissingmissing
3021Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_105115__61200.03.197870[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105115__612.json0.0missingmissingmissing
3022Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_105119__69800.03.591710[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105119__698.json0.0missingmissingmissing
3023Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105125__13910.06.151681[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105125__139.json60.0missingmissingmissing
3024Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105138__93200.013.32471[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105138__932.json55.0missingmissingmissing
3025Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105142__62800.03.485130[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105142__628.json50.0missingmissingmissing
3026Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_105028__16900.07.430750[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105028__169.json0.0missingmissingmissing
3027Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_105031__21200.03.643830[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105031__212.json0.0missingmissingmissing
3028Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_105035__54200.03.597970[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105035__542.json25.0missingmissingmissing
3029Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_105039__79000.03.850340[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105039__790.json0.0missingmissingmissing
3030Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_105044__47300.04.832220[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105044__473.json25.0missingmissingmissing
3031Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_105411__35600.06.064890[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105411__356.json50.0missingmissingmissing
3032Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_105415__86800.04.558380[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105415__868.json25.0missingmissingmissing
3033Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_105419__24500.04.04670[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105419__245.json50.0missingmissingmissing
3034Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_105423__53500.03.50170[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105423__535.json25.0missingmissingmissing
3035Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_105425__49200.02.241550[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105425__492.json25.0missingmissingmissing
3036Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_105301__29700.06.577670[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105301__297.json0.0missingmissingmissing
3037Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_105306__78900.05.505010[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105306__789.json0.0missingmissingmissing
3038Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_105310__99500.03.698620[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105310__995.json50.0missingmissingmissing
3039Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_105315__88100.04.936750[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105315__881.json50.0missingmissingmissing
3040Apple-MacBook-Pro-M1weather_data_analyzergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_105321__40530.05.802814[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105321__405.json85.0missingmissingmissing
3041Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_221028__99510.029.35381[0, 445]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_221028__995.json60.0missingmissingmissing
3042Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_221056__90910.028.83381[0, 443]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_221056__909.json60.0missingmissingmissing
3043Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_221121__91510.024.65891[0, 375]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_221121__915.json60.0missingmissingmissing
3044Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_221148__38810.026.69651[0, 411]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_221148__388.json60.0missingmissingmissing
3045Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_221215__23810.026.9981[0, 414]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_221215__238.json60.0missingmissingmissing
3046Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_220607__84510.023.74961[0, 362]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_220607__845.json60.0missingmissingmissing
3047Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_220631__97300.023.27035[0, 357]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_220631__973.json75.0missingmissingmissing
3048Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_220652__17510.021.8441[0, 337]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_220652__175.json60.0missingmissingmissing
3049Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_220717__40410.024.22521[0, 369]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_220717__404.json60.0missingmissingmissing
3050Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_220743__41110.025.96631[0, 397]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_220743__411.json60.0missingmissingmissing
3051Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_220206__82400.030.70321[0, 470]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_220206__824.json55.0missingmissingmissing
3052Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_220229__66100.022.77560[0, 345]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_220229__661.json25.0missingmissingmissing
3053Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_220250__29400.020.23891[0, 312]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_220250__294.json55.0missingmissingmissing
3054Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_220320__79700.029.86161[0, 454]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_220320__797.json55.0missingmissingmissing
3055Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_220347__58010.026.97691[0, 416]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_220347__580.json60.0missingmissingmissing
3056Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_222012__37910.027.54411[0, 413]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_222012__379.json60.0missingmissingmissing
3057Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_222042__16610.029.75521[0, 443]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_222042__166.json60.0missingmissingmissing
3058Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240223_222109__60500.027.48850[0, 415]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_222109__605.json0.0missingmissingmissing
3059Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_222135__75710.025.37851[0, 380]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_222135__757.json60.0missingmissingmissing
3060Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_222205__86010.030.3371[0, 455]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_222205__860.json60.0missingmissingmissing
3061Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_221523__38600.030.550[0, 456]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_221523__386.json0.0missingmissingmissing
3062Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_221550__57110.026.6491[0, 398]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_221550__571.json60.0missingmissingmissing
3063Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_221622__85010.032.19511[0, 486]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_221622__850.json60.0missingmissingmissing
3064Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_221651__91810.029.16771[0, 441]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_221651__918.json60.0missingmissingmissing
3065Apple-MacBook-Pro-M1weather_data_analyzergemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_221719__37800.027.34040[0, 406]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_221719__378.json0.0missingmissingmissing
3066Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboAsIs1SHOTtruetrue520231213_213558__45700.0005296.476261[140, 306]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_213558__457.json55.0missingmissingmissing
3067Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboAsIs1SHOTtruetrue520231225_184849__96310.00052755.047541[140, 305]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_184849__963.json60.0missingmissingmissing
3068Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboAsIs1SHOTtruetrue520231225_184855__80440.00067456.136155[140, 403]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_184855__804.json95.0missingmissingmissing
3069Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo--optimAsIs1SHOTtruetrue520231215_191510__71840.07.932985[140, 303]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_191510__718.json95.00.5missing0.5
3070Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboInJulia1SHOTtruetrue520231213_213551__53210.0004936.095211[143, 281]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_213551__532.json60.0missingmissingmissing
3071Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboInJulia1SHOTtruetrue520231225_184835__77940.0005625.37445[143, 327]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_184835__779.json95.0missingmissingmissing
3072Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboInJulia1SHOTtruetrue520231225_184844__81110.00078557.670431[143, 476]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_184844__811.json60.0missingmissingmissing
3073Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboInJulia1SHOTtruetrue520231227_192251__58540.0005445.406265[143, 315]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_192251__585.json95.0missingmissingmissing
3074Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboInJulia1SHOTtruetrue520231227_192259__79010.00068657.241791[143, 410]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_192259__790.json60.0missingmissingmissing
3075Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_191502__95610.06.743971[143, 321]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_191502__956.json60.00.5missing0.5
3076Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_213545__97110.00044155.250321[178, 235]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_213545__971.json60.0missingmissingmissing
3077Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_184826__47310.0003172.973991[178, 152]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_184826__473.json60.0missingmissingmissing
3078Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_184830__58310.00040853.875831[178, 213]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_184830__583.json60.0missingmissingmissing
3079Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_192243__78340.00061856.172535[178, 353]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_192243__783.json95.0missingmissingmissing
3080Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_192246__16700.0002963.014750[178, 138]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_192246__167.json50.0missingmissingmissing
3081Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_191456__69810.03.091841[178, 132]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_191456__698.json60.00.5missing0.5
3082Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_213540__85700.0004595.049550[255, 221]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213540__857.json0.0missingmissingmissing
3083Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_184819__68130.00037653.029574[255, 166]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184819__681.json85.0missingmissingmissing
3084Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_184823__72400.00038853.246330[255, 174]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184823__724.json0.0missingmissingmissing
3085Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_192232__12850.00066456.622655[255, 358]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192232__128.json100.0missingmissingmissing
3086Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_192237__37200.0004023.711520[255, 183]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192237__372.json0.0missingmissingmissing
3087Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_191452__48900.04.359390[255, 183]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_191452__489.json0.00.5missing0.5
3088Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231213_213608__13200.00054755.226460[402, 231]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213608__132.json0.0missingmissingmissing
3089Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_184906__21800.0004953.941450[402, 196]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184906__218.json0.0missingmissingmissing
3090Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_184910__95800.00046353.88690[402, 175]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184910__958.json0.0missingmissingmissing
3091Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_192310__24400.0002220.5118970[402, 14]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192310__244.json0.0missingmissingmissing
3092Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_192310__46900.0004623.160370[402, 174]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192310__469.json0.0missingmissingmissing
3093Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_191522__71000.05.893550[402, 228]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_191522__710.json0.00.5missing0.5
3094Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_213602__15400.0004994.432170[401, 199]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_213602__154.json0.0missingmissingmissing
3095Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_184859__22300.00048553.391680[401, 190]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_184859__223.json0.0missingmissingmissing
3096Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_184902__65100.00050953.003810[401, 206]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_184902__651.json0.0missingmissingmissing
3097Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_192303__43600.0004483.475660[401, 165]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_192303__436.json0.0missingmissingmissing
3098Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_192307__88200.00048853.579090[401, 192]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_192307__882.json0.0missingmissingmissing
3099Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_191516__40500.05.115530[401, 203]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_191516__405.json0.00.5missing0.5
3100Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231213_213620__71540.000573.979895[140, 215]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_213620__715.json95.0missingmissingmissing
3101Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_184928__35440.0006082.778125[140, 234]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_184928__354.json95.0missingmissingmissing
3102Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_184931__95420.000552.788515[140, 205]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_184931__954.json85.0missingmissingmissing
3103Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106--optimAsIs1SHOTtruetrue520231215_191540__30540.04.849345[140, 199]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_191540__305.json95.00.9missing0.1
3104Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_213616__60840.0005052.767545[143, 181]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_213616__608.json95.0missingmissingmissing
3105Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_184923__64840.0006013.029775[143, 229]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_184923__648.json95.0missingmissingmissing
3106Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_184926__34740.0005192.232395[143, 188]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_184926__347.json95.0missingmissingmissing
3107Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_192325__18240.0005092.911235[143, 183]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_192325__182.json95.0missingmissingmissing
3108Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_192330__90520.0006654.38123[143, 261]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_192330__905.json75.0missingmissingmissing
3109Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_191535__88940.05.932415[143, 258]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_191535__889.json95.00.9missing0.1
3110Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_213613__26300.000392.050285[178, 106]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_213613__263.json75.0missingmissingmissing
3111Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_184918__14710.0004222.043491[178, 122]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_184918__147.json60.0missingmissingmissing
3112Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_184920__42920.0004622.215693[178, 142]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_184920__429.json75.0missingmissingmissing
3113Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_192320__33640.0004282.791885[178, 125]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_192320__336.json95.0missingmissingmissing
3114Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_192322__71440.0004242.493335[178, 123]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_192322__714.json95.0missingmissingmissing
3115Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_191529__96440.02.887525[178, 125]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_191529__964.json95.00.9missing0.1
3116Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_213611__46040.0005473.351365[255, 146]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213611__460.json95.0missingmissingmissing
3117Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_184912__49240.0006192.209125[255, 182]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184912__492.json95.0missingmissingmissing
3118Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_184915__19050.0006492.706625[255, 197]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184915__190.json100.0missingmissingmissing
3119Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_192313__88140.0006013.247075[255, 173]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192313__881.json95.0missingmissingmissing
3120Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_192317__90740.0005813.243725[255, 163]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192317__907.json95.0missingmissingmissing
3121Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_191526__96440.03.536395[255, 164]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_191526__964.json95.00.9missing0.1
3122Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231213_213626__87800.0006942.688380[402, 146]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213626__878.json0.0missingmissingmissing
3123Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_184936__27600.0005761.233260[402, 87]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184936__276.json0.0missingmissingmissing
3124Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_184938__71300.0008882.82390[402, 243]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_184938__713.json0.0missingmissingmissing
3125Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_192336__83600.0005861.984340[402, 92]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192336__836.json0.0missingmissingmissing
3126Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_192338__25800.000562.049990[402, 79]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192338__258.json0.0missingmissingmissing
3127Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_191549__80800.03.355960[402, 114]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_191549__808.json0.00.9missing0.1
3128Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_213623__13330.0006732.518615[401, 136]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_213623__133.json90.0missingmissingmissing
3129Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_184933__19500.0005811.497560[401, 90]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_184933__195.json0.0missingmissingmissing
3130Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_184934__35100.0005571.347710[401, 78]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_184934__351.json0.0missingmissingmissing
3131Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_192332__27900.0005871.825870[401, 93]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_192332__279.json0.0missingmissingmissing
3132Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_192334__74600.0006832.11770[401, 141]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_192334__746.json50.0missingmissingmissing
3133Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_191546__51030.05.657064[401, 144]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_191546__510.json85.00.9missing0.1
3134Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewAsIs1SHOTtruetrue520231213_213759__81150.0151138.87445[140, 457]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_213759__811.json100.0missingmissingmissing
3135Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewAsIs1SHOTtruetrue520231225_185209__23540.0140350.60934[140, 421]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_185209__235.json90.0missingmissingmissing
3136Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewAsIs1SHOTtruetrue520231225_185226__99450.0146916.40295[140, 443]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_185226__994.json100.0missingmissingmissing
3137Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-preview--optimAsIs1SHOTtruetrue520231215_191730__89450.039.7665[140, 305]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_191730__894.json100.00.1missing0.9
3138Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewInJulia1SHOTtruetrue520231213_213719__28550.0122928.80365[143, 362]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_213719__285.json100.0missingmissingmissing
3139Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewInJulia1SHOTtruetrue520231225_185100__57850.0133722.66895[143, 398]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_185100__578.json100.0missingmissingmissing
3140Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewInJulia1SHOTtruetrue520231225_185117__88540.0161617.02384[143, 491]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_185117__885.json90.0missingmissingmissing
3141Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewInJulia1SHOTtruetrue520231227_192537__20250.0132225.92685[143, 393]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_192537__202.json100.0missingmissingmissing
3142Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewInJulia1SHOTtruetrue520231227_192650__59240.0178772.64394[143, 548]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_192650__592.json90.0missingmissingmissing
3143Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_191649__87250.034.29975[143, 374]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_191649__872.json100.00.1missing0.9
3144Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_213649__82950.0072115.13585[178, 181]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_213649__829.json100.0missingmissingmissing
3145Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_185027__12140.008839.537334[178, 235]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_185027__121.json90.0missingmissingmissing
3146Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_185037__86950.006018.924415[178, 141]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_185037__869.json100.0missingmissingmissing
3147Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_192448__59450.008211.15525[178, 214]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_192448__594.json100.0missingmissingmissing
3148Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_192510__85450.0072121.7375[178, 181]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_192510__854.json100.0missingmissingmissing
3149Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_191614__92550.010.55315[178, 139]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_191614__925.json100.00.1missing0.9
3150Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231213_213634__62100.006488.351090[255, 131]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213634__621.json0.0missingmissingmissing
3151Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_184956__63650.01517.81345[255, 415]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_184956__636.json100.0missingmissingmissing
3152Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_185017__44740.0140120.8935[255, 382]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185017__447.json95.0missingmissingmissing
3153Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_192411__32550.0121832.56625[255, 321]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192411__325.json100.0missingmissingmissing
3154Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_192437__41040.0159325.25085[255, 446]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192437__410.json95.0missingmissingmissing
3155Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_191604__82800.014.38810[255, 168]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_191604__828.json0.00.1missing0.9
3156Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_213911__87840.0173130.1065[402, 443]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213911__878.json95.0missingmissingmissing
3157Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_185422__92650.015916.94115[402, 396]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185422__926.json100.0missingmissingmissing
3158Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruefalse520231225_185445__26200.0177322.98670[402, 457]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185445__262.json25.0missingmissingmissing
3159Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_192855__52250.0223564.46275[402, 611]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192855__522.json100.0missingmissingmissing
3160Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_192914__49150.0139819.29895[402, 332]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192914__491.json100.0missingmissingmissing
3161Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_191915__11740.061.77254[402, 558]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_191915__117.json90.00.1missing0.9
3162Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_213841__12550.0210841.16935[401, 569]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_213841__125.json100.0missingmissingmissing
3163Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_185335__73040.0195567.96555[401, 518]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_185335__730.json95.0missingmissingmissing
3164Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_185404__90850.0181728.56835[401, 472]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_185404__908.json100.0missingmissingmissing
3165Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_192734__43800.0257343.54590[401, 724]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_192734__438.json50.0missingmissingmissing
3166Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-previewJuliaRecapTask1SHOTfalsefalse520231227_192750__47400.0103416.12610[401, 211]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_192750__474.json0.0missingmissingmissing
3167Apple-MacBook-Pro-M1weather_data_analyzergpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_191813__46150.042.0135[401, 441]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_191813__461.json100.00.1missing0.9
3168Apple-MacBook-Pro-M1weather_data_analyzerllama2AsIs1SHOTfalsefalse520231213_235210__79600.019.52680[138, 544]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__AsIs__1SHOT__20231213_235210__796.json0.0missingmissingmissing
3169Apple-MacBook-Pro-M1weather_data_analyzerllama2AsIs1SHOTfalsefalse520231225_004400__57400.022.43750[138, 622]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__AsIs__1SHOT__20231225_004400__574.json0.0missing{\n "num_gpu": 99\n}missing
3170Apple-MacBook-Pro-M1weather_data_analyzerllama2AsIs1SHOTfalsefalse520231225_004422__29800.021.45920[1, 623]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__AsIs__1SHOT__20231225_004422__298.json0.0missing{\n "num_gpu": 99\n}missing
3171Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruetrue520231213_235150__11200.019.7860[155, 549]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231213_235150__112.json50.0missingmissingmissing
3172Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruetrue520231225_004306__66600.021.82070[155, 604]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231225_004306__666.json50.0missing{\n "num_gpu": 99\n}missing
3173Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTtruetrue520231225_004338__46600.031.21680[1, 870]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231225_004338__466.json50.0missing{\n "num_gpu": 99\n}missing
3174Apple-MacBook-Pro-M1weather_data_analyzerllama2InJulia1SHOTfalsefalse520231226_222057__32600.030.05190[155, 825]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__InJulia__1SHOT__20231226_222057__326.json0.0missing{\n "num_gpu": 99\n}missing
3175Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTfalsefalse520231213_235131__65100.016.26520[184, 442]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231213_235131__651.json0.0missingmissingmissing
3176Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTtruetrue520231225_004227__39610.021.30751[184, 576]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_004227__396.json60.0missing{\n "num_gpu": 99\n}missing
3177Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTfalsefalse520231225_004245__37800.017.45890[1, 509]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_004245__378.json0.0missing{\n "num_gpu": 99\n}missing
3178Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertAsk1SHOTtruetrue520231226_222027__99910.020.01485[184, 550]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_222027__999.json80.0missing{\n "num_gpu": 99\n}missing
3179Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTtruetrue520231213_235114__37700.030.67950[280, 772]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235114__377.json50.0missingmissingmissing
3180Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_004134__85200.043.3740[298, 945]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004134__852.json0.0missing{\n "num_gpu": 99\n}missing
3181Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTtruetrue520231225_004205__40900.031.02045[1, 834]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004205__409.json75.0missing{\n "num_gpu": 99\n}missing
3182Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_222006__79600.031.54840[298, 679]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222006__796.json0.0missing{\n "num_gpu": 99\n}missing
3183Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTfalsefalse520231213_235252__66500.014.28540[11, 384]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235252__665.json0.0missingmissingmissing
3184Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_004549__74400.022.77650[11, 597]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004549__744.json0.0missing{\n "num_gpu": 99\n}missing
3185Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_004600__95200.010.56040[1, 293]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004600__952.json0.0missing{\n "num_gpu": 99\n}missing
3186Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapCoTTask1SHOTtruetrue520231226_222147__48200.019.18784[11, 515]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222147__482.json70.0missing{\n "num_gpu": 99\n}missing
3187Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruetrue520231213_235238__34400.027.64860[455, 612]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231213_235238__344.json50.0missingmissingmissing
3188Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruefalse520231225_004453__96400.031.77420[455, 710]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_004453__964.json25.0missing{\n "num_gpu": 99\n}missing
3189Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruetrue520231225_004526__96100.032.50245[1, 832]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_004526__961.json75.0missing{\n "num_gpu": 99\n}missing
3190Apple-MacBook-Pro-M1weather_data_analyzerllama2JuliaRecapTask1SHOTtruetrue520231226_222128__36400.030.8590[455, 697]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_222128__364.json50.0missing{\n "num_gpu": 99\n}missing
3191Apple-MacBook-Pro-M1weather_data_analyzermagicoderAsIs1SHOTfalsefalse520231214_000522__60600.020.23190[138, 564]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__AsIs__1SHOT__20231214_000522__606.json0.0missingmissingmissing
3192Apple-MacBook-Pro-M1weather_data_analyzermagicoderAsIs1SHOTfalsefalse520231225_011349__64200.011.00860[152, 346]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__AsIs__1SHOT__20231225_011349__642.json0.0missing{\n "num_gpu": 99\n}missing
3193Apple-MacBook-Pro-M1weather_data_analyzermagicoderAsIs1SHOTtruefalse520231225_011358__26900.08.905930[152, 278]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__AsIs__1SHOT__20231225_011358__269.json25.0missing{\n "num_gpu": 99\n}missing
3194Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231214_000501__87400.022.05510[155, 610]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231214_000501__874.json50.0missingmissingmissing
3195Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231225_011327__48710.010.24325[155, 322]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231225_011327__487.json80.0missing{\n "num_gpu": 99\n}missing
3196Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231225_011338__60030.011.16295[155, 352]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231225_011338__600.json90.0missing{\n "num_gpu": 99\n}missing
3197Apple-MacBook-Pro-M1weather_data_analyzermagicoderInJulia1SHOTtruetrue520231226_223209__71310.013.975[155, 443]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__InJulia__1SHOT__20231226_223209__713.json80.0missing{\n "num_gpu": 99\n}missing
3198Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruetrue520231214_000439__59500.015.70730[184, 426]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_000439__595.json50.0missingmissingmissing
3199Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruefalse520231225_011308__12500.011.66620[194, 358]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_011308__125.json25.0missing{\n "num_gpu": 99\n}missing
3200Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruefalse520231225_011317__26000.08.348740[194, 249]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_011317__260.json25.0missing{\n "num_gpu": 99\n}missing
3201Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertAsk1SHOTtruetrue520231226_223155__71330.012.92775[194, 399]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_223155__713.json90.0missing{\n "num_gpu": 99\n}missing
3202Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_000423__70600.019.8930[280, 499]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000423__706.json0.0missingmissingmissing
3203Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_011243__11900.018.50835[290, 366]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011243__119.json75.0missing{\n "num_gpu": 99\n}missing
3204Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_011256__74830.013.2025[290, 387]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011256__748.json90.0missing{\n "num_gpu": 99\n}missing
3205Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaExpertCoTTask1SHOTtruefalse520231226_223142__49900.018.61420[290, 377]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223142__499.json25.0missing{\n "num_gpu": 99\n}missing
3206Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_000617__57600.016.87560[11, 450]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000617__576.json50.0missingmissingmissing
3207Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_011437__58130.013.5535[458, 366]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011437__581.json90.0missing{\n "num_gpu": 99\n}missing
3208Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_011450__10530.012.62295[458, 338]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011450__105.json90.0missing{\n "num_gpu": 99\n}missing
3209Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_223237__83410.016.38325[458, 453]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223237__834.json80.0missing{\n "num_gpu": 99\n}missing
3210Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231214_000600__23400.038.2250[455, 859]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_000600__234.json50.0missingmissingmissing
3211Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231225_011411__73630.012.39475[455, 331]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_011411__736.json90.0missing{\n "num_gpu": 99\n}missing
3212Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231225_011424__23700.012.87640[455, 345]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_011424__237.json50.0missing{\n "num_gpu": 99\n}missing
3213Apple-MacBook-Pro-M1weather_data_analyzermagicoderJuliaRecapTask1SHOTtruetrue520231226_223220__34930.010.88985[455, 284]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_223220__349.json90.0missing{\n "num_gpu": 99\n}missing
3214Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175508__51740.017.76215[155, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175508__517.json95.0missing{\n "num_gpu": 99\n}missing
3215Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175526__83630.017.35465[155, 328]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175526__836.json90.0missing{\n "num_gpu": 99\n}missing
3216Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_175545__22040.019.04765[155, 361]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175545__220.json95.0missing{\n "num_gpu": 99\n}missing
3217Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175409__23430.014.91095[194, 273]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175409__234.json90.0missing{\n "num_gpu": 99\n}missing
3218Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_175431__21800.021.55990[194, 402]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175431__218.json25.0missing{\n "num_gpu": 99\n}missing
3219Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_175450__89930.019.5215[194, 363]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175450__899.json90.0missing{\n "num_gpu": 99\n}missing
3220Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_175308__70300.023.29915[290, 422]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175308__703.json75.0missing{\n "num_gpu": 99\n}missing
3221Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_175333__48900.024.94735[290, 453]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175333__489.json75.0missing{\n "num_gpu": 99\n}missing
3222Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_175354__76700.020.90695[290, 376]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175354__767.json75.0missing{\n "num_gpu": 99\n}missing
3223Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175713__59330.024.23535[458, 416]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175713__593.json90.0missing{\n "num_gpu": 99\n}missing
3224Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175726__49630.012.35695[458, 191]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175726__496.json90.0missing{\n "num_gpu": 99\n}missing
3225Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_175737__91830.011.19685[458, 169]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_175737__918.json90.0missing{\n "num_gpu": 99\n}missing
3226Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175608__76130.022.63195[455, 386]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175608__761.json90.0missing{\n "num_gpu": 99\n}missing
3227Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175628__75130.019.97835[455, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175628__751.json90.0missing{\n "num_gpu": 99\n}missing
3228Apple-MacBook-Pro-M1weather_data_analyzermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_175649__15540.021.20015[455, 359]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175649__155.json95.0missing{\n "num_gpu": 99\n}missing
3229Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumAsIs1SHOTtruetrue520231213_214419__31730.0039888741.94865[150, 443]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__AsIs__1SHOT__20231213_214419__317.json90.0missingmissingmissing
3230Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumAsIs1SHOTtruetrue520231225_185845__80040.003454938.475485[150, 377]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__AsIs__1SHOT__20231225_185845__800.json95.0missingmissingmissing
3231Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumAsIs1SHOTtruetrue520231225_185900__85840.0058333915.1165[150, 671]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__AsIs__1SHOT__20231225_185900__858.json95.0missingmissingmissing
3232Apple-MacBook-Pro-M1weather_data_analyzermistral-medium--optimAsIs1SHOTtruetrue520231215_192135__91730.07.251795[150, 327]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__AsIs__1SHOT__20231215_192135__917.json90.00.9missing0.3
3233Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumInJulia1SHOTtruetrue520231213_214337__35550.0035924740.85515[153, 393]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__InJulia__1SHOT__20231213_214337__355.json100.0missingmissingmissing
3234Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumInJulia1SHOTtruetrue520231225_185826__52540.0038270818.71395[153, 422]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__InJulia__1SHOT__20231225_185826__525.json95.0missingmissingmissing
3235Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumInJulia1SHOTtruetrue520231225_185837__86740.0042396710.55395[153, 473]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__InJulia__1SHOT__20231225_185837__867.json95.0missingmissingmissing
3236Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumInJulia1SHOTtruetrue520231227_193258__30840.0042882121.97985[153, 479]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__InJulia__1SHOT__20231227_193258__308.json95.0missingmissingmissing
3237Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumInJulia1SHOTtruetrue520231227_193320__49020.0044095621.98995[153, 494]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__InJulia__1SHOT__20231227_193320__490.json85.0missingmissingmissing
3238Apple-MacBook-Pro-M1weather_data_analyzermistral-medium--optimInJulia1SHOTtruetrue520231215_192128__96530.09.068945[153, 409]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__InJulia__1SHOT__20231215_192128__965.json90.00.9missing0.3
3239Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_214256__13230.0028968642.31035[192, 294]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_214256__132.json90.0missingmissingmissing
3240Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_185746__28240.0027269715.24355[192, 273]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_185746__282.json95.0missingmissingmissing
3241Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_185807__87430.0031557420.3225[192, 326]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_185807__874.json90.0missingmissingmissing
3242Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_193215__21630.0035197923.11795[192, 371]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_193215__216.json90.0missingmissingmissing
3243Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_193236__16030.003673520.59525[192, 390]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_193236__160.json90.0missingmissingmissing
3244Apple-MacBook-Pro-M1weather_data_analyzermistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_192118__73440.06.720495[192, 299]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_192118__734.json95.00.9missing0.3
3245Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_215205__24640.0046769876.36945[288, 482]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_215205__246.json95.0missingmissingmissing
3246Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_185717__75640.003414948.495335[288, 326]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185717__756.json95.0missingmissingmissing
3247Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_185731__53240.0056558713.6415[288, 603]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185731__532.json95.0missingmissingmissing
3248Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_193138__69140.0046931611.26455[288, 484]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193138__691.json95.0missingmissingmissing
3249Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_193152__16720.004984414.06295[288, 520]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193152__167.json85.0missingmissingmissing
3250Apple-MacBook-Pro-M1weather_data_analyzermistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_192111__91440.061.65375[288, 520]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192111__914.json95.00.9missing0.3
3251Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_214546__92030.0038577529.49784[455, 325]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_214546__920.json85.0missingmissingmissing
3252Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_185951__16800.0061472214.13670[455, 608]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185951__168.json50.0missingmissingmissing
3253Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_190023__94200.0046829331.36790[455, 427]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190023__942.json50.0missingmissingmissing
3254Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_193430__19600.0051440624.57644[455, 484]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193430__196.json70.0missingmissingmissing
3255Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_193517__85010.0058559847.07164[455, 572]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193517__850.json75.0missingmissingmissing
3256Apple-MacBook-Pro-M1weather_data_analyzermistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_192352__19400.076.10422[455, 530]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192352__194.json60.00.9missing0.3
3257Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapTask1SHOTtruetrue520231213_214516__63920.0060824957.17584[452, 601]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_214516__639.json80.0missingmissingmissing
3258Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_185923__27330.0048770821.13754[452, 452]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_185923__273.json85.0missingmissingmissing
3259Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_185937__90010.0048123613.30954[452, 444]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_185937__900.json75.0missingmissingmissing
3260Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapTask1SHOTtruetrue520231227_193334__37540.0049903413.68034[452, 466]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_193334__375.json90.0missingmissingmissing
3261Apple-MacBook-Pro-M1weather_data_analyzermistral-mediumJuliaRecapTask1SHOTtruetrue520231227_193405__36230.0057912530.26134[452, 565]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_193405__362.json85.0missingmissingmissing
3262Apple-MacBook-Pro-M1weather_data_analyzermistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_192235__78420.060.3774[452, 398]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_192235__784.json80.00.9missing0.3
3263Apple-MacBook-Pro-M1weather_data_analyzermistral-smallAsIs1SHOTtruetrue520231213_214013__59810.001153717.369611[155, 543]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__AsIs__1SHOT__20231213_214013__598.json60.0missingmissingmissing
3264Apple-MacBook-Pro-M1weather_data_analyzermistral-smallAsIs1SHOTtruefalse520231225_185617__26500.0008297256.164020[155, 376]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__AsIs__1SHOT__20231225_185617__265.json25.0missingmissingmissing
3265Apple-MacBook-Pro-M1weather_data_analyzermistral-smallAsIs1SHOTfalsefalse520231225_185619__15300.0002089251.157650[155, 56]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__AsIs__1SHOT__20231225_185619__153.json0.0missingmissingmissing
3266Apple-MacBook-Pro-M1weather_data_analyzermistral-small--optimAsIs1SHOTtruefalse520231215_191956__64200.05.478490[155, 409]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__AsIs__1SHOT__20231215_191956__642.json25.00.9missing0.3
3267Apple-MacBook-Pro-M1weather_data_analyzermistral-smallInJulia1SHOTtruetrue520231213_214005__67930.0009674666.03635[158, 446]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__InJulia__1SHOT__20231213_214005__679.json90.0missingmissingmissing
3268Apple-MacBook-Pro-M1weather_data_analyzermistral-smallInJulia1SHOTtruetrue520231225_185606__73410.0006900464.281681[158, 303]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__InJulia__1SHOT__20231225_185606__734.json60.0missingmissingmissing
3269Apple-MacBook-Pro-M1weather_data_analyzermistral-smallInJulia1SHOTtruetrue520231225_185611__17600.0007657064.686840[158, 342]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__InJulia__1SHOT__20231225_185611__176.json50.0missingmissingmissing
3270Apple-MacBook-Pro-M1weather_data_analyzermistral-smallInJulia1SHOTtruetrue520231227_193024__97140.0007133265.731295[158, 315]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__InJulia__1SHOT__20231227_193024__971.json95.0missingmissingmissing
3271Apple-MacBook-Pro-M1weather_data_analyzermistral-smallInJulia1SHOTtruetrue520231227_193029__40900.0007734664.683990[158, 346]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__InJulia__1SHOT__20231227_193029__409.json50.0missingmissingmissing
3272Apple-MacBook-Pro-M1weather_data_analyzermistral-small--optimInJulia1SHOTtruetrue520231215_191951__66840.04.557725[158, 343]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__InJulia__1SHOT__20231215_191951__668.json95.00.9missing0.3
3273Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertAsk1SHOTtruetrue520231213_213959__55700.0007204534.186660[199, 305]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_213959__557.json50.0missingmissingmissing
3274Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_185558__75300.0008562535.210770[199, 375]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_185558__753.json50.0missingmissingmissing
3275Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_185602__48200.0005768933.285350[199, 231]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_185602__482.json50.0missingmissingmissing
3276Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_193012__97600.0006467334.039520[199, 267]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_193012__976.json50.0missingmissingmissing
3277Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_193018__56300.0007010536.114340[199, 295]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_193018__563.json50.0missingmissingmissing
3278Apple-MacBook-Pro-M1weather_data_analyzermistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_191946__16500.03.919590[199, 295]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_191946__165.json50.00.9missing0.3
3279Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231213_213955__81200.0007806256.076150[295, 304]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213955__812.json0.0missingmissingmissing
3280Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_185547__80240.00100765.743025[295, 421]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185547__802.json95.0missingmissingmissing
3281Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231225_185553__81400.001030896.037810[295, 433]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185553__814.json0.0missingmissingmissing
3282Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231227_193004__72700.0003557651.528170[295, 85]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193004__727.json0.0missingmissingmissing
3283Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231227_193008__45000.0007786854.186060[295, 303]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193008__450.json0.0missingmissingmissing
3284Apple-MacBook-Pro-M1weather_data_analyzermistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_191942__41540.06.016425[295, 453]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_191942__415.json95.00.9missing0.3
3285Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_214033__40000.001431878.123671[465, 583]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_214033__400.json55.0missingmissingmissing
3286Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_185656__12110.001325187.222041[465, 528]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185656__121.json60.0missingmissingmissing
3287Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_185708__37410.002019712.03361[465, 886]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185708__374.json60.0missingmissingmissing
3288Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_193107__95310.0024484416.69214[465, 1107]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193107__953.json75.0missingmissingmissing
3289Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_193126__29110.0029470218.96131[465, 1364]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193126__291.json60.0missingmissingmissing
3290Apple-MacBook-Pro-M1weather_data_analyzermistral-small--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_192010__82100.04.135630[465, 304]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192010__821.json0.00.9missing0.3
3291Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapTask1SHOTtruetrue520231213_214025__30420.0019621411.90995[463, 857]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_214025__304.json85.0missingmissingmissing
3292Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapTask1SHOTtruetrue520231225_185628__51810.001589669.147861[463, 665]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_185628__518.json60.0missingmissingmissing
3293Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapTask1SHOTtruetrue520231225_185648__66440.0029243820.40065[463, 1353]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_185648__664.json95.0missingmissingmissing
3294Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapTask1SHOTtruetrue520231227_193038__51210.001517888.655321[463, 628]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_193038__512.json60.0missingmissingmissing
3295Apple-MacBook-Pro-M1weather_data_analyzermistral-smallJuliaRecapTask1SHOTtruetrue520231227_193050__14930.002047512.35054[463, 901]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_193050__149.json85.0missingmissingmissing
3296Apple-MacBook-Pro-M1weather_data_analyzermistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_192005__48610.08.656261[463, 628]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_192005__486.json60.00.9missing0.3
3297Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyAsIs1SHOTfalsefalse520231213_213932__14800.0002468417.255530[155, 497]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__AsIs__1SHOT__20231213_213932__148.json0.0missingmissingmissing
3298Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyAsIs1SHOTfalsefalse520231225_185515__66300.000252734.453090[155, 510]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__AsIs__1SHOT__20231225_185515__663.json0.0missingmissingmissing
3299Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyAsIs1SHOTfalsefalse520231225_185519__53900.000252734.441330[155, 510]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__AsIs__1SHOT__20231225_185519__539.json0.0missingmissingmissing
3300Apple-MacBook-Pro-M1weather_data_analyzermistral-tiny--optimAsIs1SHOTfalsefalse520231215_191928__18600.02.936870[155, 350]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__AsIs__1SHOT__20231215_191928__186.json0.00.9missing0.3
3301Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyInJulia1SHOTtruetrue520231213_213925__18910.0001743285.075281[158, 336]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__InJulia__1SHOT__20231213_213925__189.json60.0missingmissingmissing
3302Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyInJulia1SHOTtruetrue520231225_185507__12910.0002101153.585261[158, 415]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__InJulia__1SHOT__20231225_185507__129.json60.0missingmissingmissing
3303Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyInJulia1SHOTtruetrue520231225_185510__80950.0001779523.115545[158, 344]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__InJulia__1SHOT__20231225_185510__809.json100.0missingmissingmissing
3304Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyInJulia1SHOTtruetrue520231227_192935__14620.0001824823.079093[158, 354]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__InJulia__1SHOT__20231227_192935__146.json75.0missingmissingmissing
3305Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyInJulia1SHOTtruetrue520231227_192939__26710.0002377484.216981[158, 476]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__InJulia__1SHOT__20231227_192939__267.json60.0missingmissingmissing
3306Apple-MacBook-Pro-M1weather_data_analyzermistral-tiny--optimInJulia1SHOTfalsefalse520231215_191925__70400.03.190720[158, 375]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__InJulia__1SHOT__20231215_191925__704.json0.00.9missing0.3
3307Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_213920__50300.000104873.203860[199, 170]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_213920__503.json50.0missingmissingmissing
3308Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_185501__25300.0001116651.7610[199, 185]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_185501__253.json50.0missingmissingmissing
3309Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_185503__13819.5357e-51.856741[199, 149]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_185503__138.json60.0missingmissingmissing
3310Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231227_192929__81100.0001107591.803550[199, 183]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_192929__811.json0.0missingmissingmissing
3311Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_192932__56600.0001578712.54920[199, 287]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_192932__566.json50.0missingmissingmissing
3312Apple-MacBook-Pro-M1weather_data_analyzermistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_191921__31200.01.532680[199, 151]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_191921__312.json50.00.9missing0.3
3313Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231213_213916__85600.0001916964.789320[295, 332]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_213916__856.json0.0missingmissingmissing
3314Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_185455__67540.0002922629.421635[295, 554]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185455__675.json95.0missingmissingmissing
3315Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_185459__72700.0002510394.15740[295, 463]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_185459__727.json0.0missingmissingmissing
3316Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_192923__68700.0001957738.943990[295, 341]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192923__687.json50.0missingmissingmissing
3317Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_192928__18200.0002428854.143880[295, 445]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_192928__182.json50.0missingmissingmissing
3318Apple-MacBook-Pro-M1weather_data_analyzermistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_191920__68200.04.93440[295, 364]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_191920__682.json50.00.9missing0.3
3319Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_213949__10410.0003088146.545241[465, 538]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_213949__104.json60.0missingmissingmissing
3320Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_185537__26310.0002123252.957041[465, 325]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185537__263.json60.0missingmissingmissing
3321Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_185541__30610.000228183.246311[465, 360]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_185541__306.json60.0missingmissingmissing
3322Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_192957__84440.0002716684.303385[465, 456]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_192957__844.json95.0missingmissingmissing
3323Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_193002__13810.0002848054.627431[465, 485]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193002__138.json60.0missingmissingmissing
3324Apple-MacBook-Pro-M1weather_data_analyzermistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_191936__52240.03.734845[465, 436]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_191936__522.json95.00.9missing0.3
3325Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapTask1SHOTtruetrue520231213_213942__94640.0003135179.480315[463, 549]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_213942__946.json95.0missingmissingmissing
3326Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapTask1SHOTtruetrue520231225_185527__57240.0002378667.978955[463, 382]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_185527__572.json95.0missingmissingmissing
3327Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapTask1SHOTtruetrue520231225_185534__46300.000404576.651025[463, 750]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_185534__463.json75.0missingmissingmissing
3328Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapTask1SHOTfalsefalse520231227_192948__50700.0002070628.446120[463, 314]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_192948__507.json0.0missingmissingmissing
3329Apple-MacBook-Pro-M1weather_data_analyzermistral-tinyJuliaRecapTask1SHOTtruetrue520231227_192953__85410.0002645934.285451[463, 441]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_192953__854.json60.0missingmissingmissing
3330Apple-MacBook-Pro-M1weather_data_analyzermistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_191932__38100.04.213185[463, 488]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_191932__381.json75.00.9missing0.3
3331Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MAsIs1SHOTtruefalse520231219_222547__21400.025.59260[138, 706]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_222547__214.json25.0missingmissingmissing
3332Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_222611__90000.024.49440[1, 704]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_222611__900.json0.0missingmissingmissing
3333Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_222634__74300.023.22030[1, 671]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_222634__743.json0.0missingmissingmissing
3334Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_015151__72900.014.72110[154, 358]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_015151__729.json0.0missing{\n "num_gpu": 99\n}missing
3335Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_015207__48600.015.74240[154, 384]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_015207__486.json0.0missing{\n "num_gpu": 99\n}missing
3336Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231219_222501__87100.026.77590[1, 762]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_222501__871.json50.0missingmissingmissing
3337Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231219_222521__41900.020.14130[1, 589]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_222521__419.json50.0missingmissingmissing
3338Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_015119__35600.014.3970[157, 350]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_015119__356.json25.0missing{\n "num_gpu": 99\n}missing
3339Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_015136__51700.017.38610[157, 425]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_015136__517.json50.0missing{\n "num_gpu": 99\n}missing
3340Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_225055__30330.016.64695[157, 406]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_225055__303.json90.0missing{\n "num_gpu": 99\n}missing
3341Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_222400__18700.012.96630[1, 387]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_222400__187.json50.0missingmissingmissing
3342Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_222416__11600.015.45090[1, 456]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_222416__116.json50.0missingmissingmissing
3343Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015056__68510.016.28271[198, 388]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015056__685.json60.0missing{\n "num_gpu": 99\n}missing
3344Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015104__15200.07.983441[198, 177]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015104__152.json55.0missing{\n "num_gpu": 99\n}missing
3345Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_225039__62500.07.077080[198, 154]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_225039__625.json0.0missing{\n "num_gpu": 99\n}missing
3346Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_222315__71110.023.94045[1, 662]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222315__711.json80.0missingmissingmissing
3347Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_222334__35400.018.56041[1, 525]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222334__354.json55.0missingmissingmissing
3348Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_015037__42400.022.46485[294, 381]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015037__424.json75.0missing{\n "num_gpu": 99\n}missing
3349Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_015040__83800.02.926540[294, 33]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015040__838.json0.0missing{\n "num_gpu": 99\n}missing
3350Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_225031__14320.028.36015[294, 536]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225031__143.json85.0missing{\n "num_gpu": 99\n}missing
3351Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_222740__42700.021.84170[1, 581]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222740__427.json0.0missingmissingmissing
3352Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_222801__83700.020.34790[1, 544]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222801__837.json0.0missingmissingmissing
3353Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015307__19900.021.1050[465, 460]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015307__199.json50.0missing{\n "num_gpu": 99\n}missing
3354Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015329__39200.021.88490[465, 479]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015329__392.json50.0missing{\n "num_gpu": 99\n}missing
3355Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_225136__67900.018.85990[465, 406]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225136__679.json50.0missing{\n "num_gpu": 99\n}missing
3356Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_222712__89200.010.73210[1, 298]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222712__892.json0.0missingmissingmissing
3357Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_222714__34300.02.155990[1, 62]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222714__343.json0.0missingmissingmissing
3358Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_015224__95300.017.2050[463, 366]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015224__953.json0.0missing{\n "num_gpu": 99\n}missing
3359Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_015246__44200.021.78915[463, 477]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015246__442.json75.0missing{\n "num_gpu": 99\n}missing
3360Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_225117__78000.022.10635[463, 484]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_225117__780.json75.0missing{\n "num_gpu": 99\n}missing
3361Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225911__71510.015.93331[156, 490]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225911__715.json60.0missing{\n "num_gpu": 99\n}missing
3362Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225922__29300.010.30670[156, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225922__293.json50.0missing{\n "num_gpu": 99\n}missing
3363Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225933__47840.011.79454[156, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225933__478.json90.0missing{\n "num_gpu": 99\n}missing
3364Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225945__89410.011.17021[156, 340]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225945__894.json60.0missing{\n "num_gpu": 99\n}missing
3365Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_225958__79910.012.48731[156, 382]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_225958__799.json60.0missing{\n "num_gpu": 99\n}missing
3366Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225830__50900.05.705080[197, 150]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225830__509.json50.0missing{\n "num_gpu": 99\n}missing
3367Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225837__54010.06.698681[197, 186]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225837__540.json60.0missing{\n "num_gpu": 99\n}missing
3368Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225842__23210.05.736665[197, 155]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225842__232.json80.0missing{\n "num_gpu": 99\n}missing
3369Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_225849__57300.06.532780[197, 181]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225849__573.json0.0missing{\n "num_gpu": 99\n}missing
3370Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_225855__59410.06.154351[197, 169]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_225855__594.json60.0missing{\n "num_gpu": 99\n}missing
3371Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225714__83110.016.06151[293, 439]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225714__831.json60.0missing{\n "num_gpu": 99\n}missing
3372Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225732__52710.018.30421[293, 531]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225732__527.json60.0missing{\n "num_gpu": 99\n}missing
3373Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_225748__66600.015.70050[293, 452]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225748__666.json25.0missing{\n "num_gpu": 99\n}missing
3374Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225807__16020.019.19784[293, 559]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225807__160.json80.0missing{\n "num_gpu": 99\n}missing
3375Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_225823__36720.014.80735[293, 425]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_225823__367.json85.0missing{\n "num_gpu": 99\n}missing
3376Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230132__80030.013.18294[464, 344]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230132__800.json85.0missing{\n "num_gpu": 99\n}missing
3377Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230148__51010.015.21761[464, 405]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230148__510.json60.0missing{\n "num_gpu": 99\n}missing
3378Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230159__63810.011.31181[464, 286]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230159__638.json60.0missing{\n "num_gpu": 99\n}missing
3379Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_230216__98100.016.31780[464, 438]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230216__981.json25.0missing{\n "num_gpu": 99\n}missing
3380Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_230231__70410.015.03261[464, 399]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230231__704.json60.0missing{\n "num_gpu": 99\n}missing
3381Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_230020__40810.022.11621[462, 608]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230020__408.json60.0missing{\n "num_gpu": 99\n}missing
3382Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_230033__63110.013.19951[462, 344]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230033__631.json60.0missing{\n "num_gpu": 99\n}missing
3383Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_230046__36510.012.38231[462, 319]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230046__365.json60.0missing{\n "num_gpu": 99\n}missing
3384Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_230102__39100.015.83780[462, 423]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230102__391.json25.0missing{\n "num_gpu": 99\n}missing
3385Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_230119__92000.017.29610[462, 467]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_230119__920.json0.0missing{\n "num_gpu": 99\n}missing
3386Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230518__13900.021.16330[156, 517]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230518__139.json50.0missing{\n "num_gpu": 99\n}missing
3387Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230537__92400.018.88780[156, 461]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230537__924.json50.0missing{\n "num_gpu": 99\n}missing
3388Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230551__19200.013.77870[156, 333]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230551__192.json50.0missing{\n "num_gpu": 99\n}missing
3389Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230606__19700.015.29590[156, 371]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230606__197.json50.0missing{\n "num_gpu": 99\n}missing
3390Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_230621__31500.014.50720[156, 351]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_230621__315.json50.0missing{\n "num_gpu": 99\n}missing
3391Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230421__67620.08.718034[197, 195]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230421__676.json80.0missing{\n "num_gpu": 99\n}missing
3392Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230430__10410.08.811391[197, 197]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230430__104.json60.0missing{\n "num_gpu": 99\n}missing
3393Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230437__21640.07.285735[197, 158]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230437__216.json95.0missing{\n "num_gpu": 99\n}missing
3394Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230446__22800.08.342640[197, 185]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230446__228.json50.0missing{\n "num_gpu": 99\n}missing
3395Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_230457__68810.010.75991[197, 247]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_230457__688.json60.0missing{\n "num_gpu": 99\n}missing
3396Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230258__15000.026.87345[293, 608]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230258__150.json75.0missing{\n "num_gpu": 99\n}missing
3397Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230311__19220.013.59035[293, 303]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230311__192.json85.0missing{\n "num_gpu": 99\n}missing
3398Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230325__75800.013.40330[293, 298]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230325__758.json50.0missing{\n "num_gpu": 99\n}missing
3399Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230345__69900.020.28520[293, 468]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230345__699.json50.0missing{\n "num_gpu": 99\n}missing
3400Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_230412__40000.026.89610[293, 628]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_230412__400.json50.0missing{\n "num_gpu": 99\n}missing
3401Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_230835__73000.022.92440[464, 501]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230835__730.json0.0missing{\n "num_gpu": 99\n}missing
3402Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_230856__89030.019.99974[464, 432]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230856__890.json85.0missing{\n "num_gpu": 99\n}missing
3403Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_230914__40120.018.14122[464, 387]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230914__401.json70.0missing{\n "num_gpu": 99\n}missing
3404Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_230940__87100.026.45020[464, 585]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_230940__871.json50.0missing{\n "num_gpu": 99\n}missing
3405Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_231009__82300.028.4950[464, 633]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231009__823.json0.0missing{\n "num_gpu": 99\n}missing
3406Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230638__87110.017.10581[462, 362]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230638__871.json60.0missing{\n "num_gpu": 99\n}missing
3407Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230655__12710.016.96491[462, 358]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230655__127.json60.0missing{\n "num_gpu": 99\n}missing
3408Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230724__74050.028.53645[462, 634]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230724__740.json100.0missing{\n "num_gpu": 99\n}missing
3409Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230747__17450.022.47995[462, 491]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230747__174.json100.0missing{\n "num_gpu": 99\n}missing
3410Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_230812__21940.024.75665[462, 545]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_230812__219.json95.0missing{\n "num_gpu": 99\n}missing
3411Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_120725__67500.024.04260[153, 430]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_120725__675.json0.0missing{\n "num_gpu": 99\n}missing
3412Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_120744__81600.019.09950[153, 340]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_120744__816.json0.0missing{\n "num_gpu": 99\n}missing
3413Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120640__91710.018.23281[156, 322]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120640__917.json60.0missing{\n "num_gpu": 99\n}missing
3414Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_120701__30900.020.55660[156, 366]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_120701__309.json50.0missing{\n "num_gpu": 99\n}missing
3415Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_225530__42410.019.86291[156, 356]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_225530__424.json60.0missing{\n "num_gpu": 99\n}missing
3416Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_120612__40200.08.816050[197, 142]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120612__402.json0.0missing{\n "num_gpu": 99\n}missing
3417Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_120622__86000.09.828260[197, 159]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120622__860.json0.0missing{\n "num_gpu": 99\n}missing
3418Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_225509__75610.011.41691[197, 192]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_225509__756.json60.0missing{\n "num_gpu": 99\n}missing
3419Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120535__34900.032.03540[293, 553]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120535__349.json50.0missing{\n "num_gpu": 99\n}missing
3420Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_120603__95500.027.75790[293, 476]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120603__955.json50.0missing{\n "num_gpu": 99\n}missing
3421Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_225458__60500.034.05640[293, 436]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225458__605.json0.0missing{\n "num_gpu": 99\n}missing
3422Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120903__19720.021.43055[464, 338]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120903__197.json85.0missing{\n "num_gpu": 99\n}missing
3423Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_120931__93810.028.30091[464, 455]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_120931__938.json60.0missing{\n "num_gpu": 99\n}missing
3424Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_225633__64410.023.7331[464, 385]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225633__644.json60.0missing{\n "num_gpu": 99\n}missing
3425Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_120809__43320.024.92994[462, 396]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120809__433.json80.0missing{\n "num_gpu": 99\n}missing
3426Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_120842__82800.032.29730[462, 522]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_120842__828.json0.0missing{\n "num_gpu": 99\n}missing
3427Apple-MacBook-Pro-M1weather_data_analyzermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_225609__67610.038.97941[462, 655]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_225609__676.json60.0missing{\n "num_gpu": 99\n}missing
3428Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_105356__46230.061.91225[159, 340]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_105356__462.json90.0missing{\n "num_gpu": 99\n}missing
3429Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_105529__38810.093.09291[159, 507]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_105529__388.json60.0missing{\n "num_gpu": 99\n}missing
3430Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_105614__47120.045.04025[159, 250]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_105614__471.json85.0missing{\n "num_gpu": 99\n}missing
3431Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_143856__83200.056.17720[159, 318]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_143856__832.json50.0missing{\n "num_gpu": 99\n}missing
3432Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_144018__12630.081.22814[159, 467]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_144018__126.json85.0missing{\n "num_gpu": 99\n}missing
3433Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_105135__10810.059.15672[198, 327]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_105135__108.json65.0missing{\n "num_gpu": 99\n}missing
3434Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_105223__82300.047.54280[198, 257]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_105223__823.json0.0missing{\n "num_gpu": 99\n}missing
3435Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_105254__28400.030.50510[198, 154]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_105254__284.json0.0missing{\n "num_gpu": 99\n}missing
3436Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_143710__84000.039.99770[198, 208]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_143710__840.json0.0missing{\n "num_gpu": 99\n}missing
3437Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_143800__64200.050.47850[198, 274]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_143800__642.json50.0missing{\n "num_gpu": 99\n}missing
3438Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_104819__42000.0113.6630[290, 598]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104819__420.json0.0missing{\n "num_gpu": 99\n}missing
3439Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_104945__83710.086.15741[290, 469]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_104945__837.json60.0missing{\n "num_gpu": 99\n}missing
3440Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_105036__26000.050.69960[290, 260]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_105036__260.json0.0missing{\n "num_gpu": 99\n}missing
3441Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_143459__83610.073.79591[290, 395]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_143459__836.json60.0missing{\n "num_gpu": 99\n}missing
3442Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_143628__84120.087.83325[290, 477]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_143628__841.json85.0missing{\n "num_gpu": 99\n}missing
3443Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_110048__24700.012.60120[472, 4]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110048__247.json0.0missing{\n "num_gpu": 99\n}missing
3444Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_110146__67500.058.83940[472, 278]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110146__675.json50.0missing{\n "num_gpu": 99\n}missing
3445Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_110159__43100.012.71260[472, 5]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110159__431.json0.0missing{\n "num_gpu": 99\n}missing
3446Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_144503__85900.0122.7080[472, 641]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_144503__859.json0.0missing{\n "num_gpu": 99\n}missing
3447Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_144516__72000.012.75860[472, 4]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_144516__720.json0.0missing{\n "num_gpu": 99\n}missing
3448Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_105756__50700.0100.4520[470, 516]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_105756__507.json0.0missing{\n "num_gpu": 99\n}missing
3449Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_105946__36940.0110.0035[470, 571]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_105946__369.json95.0missing{\n "num_gpu": 99\n}missing
3450Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_110035__18810.048.39915[470, 216]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_110035__188.json80.0missing{\n "num_gpu": 99\n}missing
3451Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_144048__87200.030.17510[470, 108]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_144048__872.json0.0missing{\n "num_gpu": 99\n}missing
3452Apple-MacBook-Pro-M1weather_data_analyzernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_144300__96430.0131.4595[470, 690]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_144300__964.json90.0missing{\n "num_gpu": 99\n}missing
3453Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_223136__44700.021.85190[138, 608]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_223136__447.json0.0missingmissingmissing
3454Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_223159__63500.022.65280[1, 656]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_223159__635.json0.0missingmissingmissing
3455Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_223218__41300.018.96030[1, 558]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_223218__413.json0.0missingmissingmissing
3456Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_015518__79500.015.34850[162, 369]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_015518__795.json0.0missing{\n "num_gpu": 99\n}missing
3457Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_015535__55600.017.58460[162, 426]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_015535__556.json0.0missing{\n "num_gpu": 99\n}missing
3458Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_223056__31600.019.34160[1, 568]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_223056__316.json0.0missingmissingmissing
3459Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231219_223115__85700.018.60614[1, 548]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_223115__857.json70.0missingmissingmissing
3460Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_015450__73500.012.95474[165, 309]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_015450__735.json70.0missing{\n "num_gpu": 99\n}missing
3461Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_015502__14120.012.22393[165, 290]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_015502__141.json75.0missing{\n "num_gpu": 99\n}missing
3462Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231226_225220__81400.015.55511[165, 374]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_225220__814.json55.0missing{\n "num_gpu": 99\n}missing
3463Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_223004__44400.020.68220[1, 597]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_223004__444.json0.0missingmissingmissing
3464Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_223017__78100.013.10260[1, 391]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_223017__781.json50.0missingmissingmissing
3465Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015420__72300.09.123534[206, 206]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015420__723.json70.0missing{\n "num_gpu": 99\n}missing
3466Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_015437__18200.016.2030[206, 385]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_015437__182.json50.0missing{\n "num_gpu": 99\n}missing
3467Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_225205__40300.010.03764[206, 229]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_225205__403.json70.0missing{\n "num_gpu": 99\n}missing
3468Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_222906__16300.024.12870[1, 667]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222906__163.json0.0missingmissingmissing
3469Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_222928__14310.022.0211[1, 614]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_222928__143.json60.0missingmissingmissing
3470Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_015351__83000.021.91911[302, 353]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015351__830.json55.0missing{\n "num_gpu": 99\n}missing
3471Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_015411__15000.019.11491[302, 440]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015411__150.json55.0missing{\n "num_gpu": 99\n}missing
3472Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_225154__41910.017.85481[302, 261]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225154__419.json60.0missing{\n "num_gpu": 99\n}missing
3473Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_223448__91200.08.528380[1, 239]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_223448__912.json0.0missingmissingmissing
3474Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_223528__14000.040.04950[1, 1002]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_223528__140.json0.0missingmissingmissing
3475Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015618__11000.011.59960[473, 228]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015618__110.json50.0missing{\n "num_gpu": 99\n}missing
3476Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015639__11440.021.01265[473, 457]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015639__114.json95.0missing{\n "num_gpu": 99\n}missing
3477Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_225301__73500.023.88410[473, 525]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225301__735.json50.0missing{\n "num_gpu": 99\n}missing
3478Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_223336__63700.022.22860[1, 591]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_223336__637.json0.0missingmissingmissing
3479Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_223437__87500.060.92321[1, 1436]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_223437__875.json55.0missingmissingmissing
3480Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_015551__44720.015.78965[471, 331]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015551__447.json85.0missing{\n "num_gpu": 99\n}missing
3481Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_015607__44140.014.62845[471, 302]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_015607__441.json95.0missing{\n "num_gpu": 99\n}missing
3482Apple-MacBook-Pro-M1weather_data_analyzeropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_225237__86620.015.6555[471, 327]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_225237__866.json85.0missing{\n "num_gpu": 99\n}missing
3483Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralAsIs1SHOTfalsefalse520231213_235409__76500.023.42220[138, 649]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231213_235409__765.json0.0missingmissingmissing
3484Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_004741__10100.012.86660[160, 400]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_004741__101.json0.0missing{\n "num_gpu": 99\n}missing
3485Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_004758__56000.016.82440[160, 525]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_004758__560.json0.0missing{\n "num_gpu": 99\n}missing
3486Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231213_235345__28500.016.7544[155, 466]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231213_235345__285.json70.0missingmissingmissing
3487Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_004718__66040.013.355[163, 411]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_004718__660.json95.0missing{\n "num_gpu": 99\n}missing
3488Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_004728__70010.09.082861[163, 269]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_004728__700.json60.0missing{\n "num_gpu": 99\n}missing
3489Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralInJulia1SHOTtruetrue520231226_222238__99650.013.99875[163, 433]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_222238__996.json100.0missing{\n "num_gpu": 99\n}missing
3490Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231213_235328__80700.016.7983[184, 455]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231213_235328__807.json65.0missingmissingmissing
3491Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_004654__13140.011.31955[204, 339]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_004654__131.json95.0missing{\n "num_gpu": 99\n}missing
3492Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_004704__35920.010.47135[204, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_004704__359.json85.0missing{\n "num_gpu": 99\n}missing
3493Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_222224__60630.012.87945[204, 390]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_222224__606.json90.0missing{\n "num_gpu": 99\n}missing
3494Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231213_235311__72200.018.76380[280, 469]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235311__722.json0.0missingmissingmissing
3495Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_004624__36030.024.49815[300, 563]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004624__360.json90.0missing{\n "num_gpu": 99\n}missing
3496Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_004642__26300.015.87724[300, 459]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004642__263.json70.0missing{\n "num_gpu": 99\n}missing
3497Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_222210__35740.022.58585[300, 518]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222210__357.json95.0missing{\n "num_gpu": 99\n}missing
3498Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231213_235451__68200.017.90510[11, 476]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235451__682.json50.0missingmissingmissing
3499Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_004854__82710.018.62272[471, 513]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004854__827.json65.0missing{\n "num_gpu": 99\n}missing
3500Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_004907__39700.013.10660[471, 344]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_004907__397.json50.0missing{\n "num_gpu": 99\n}missing
3501Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231226_222311__48230.018.41365[471, 508]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222311__482.json90.0missing{\n "num_gpu": 99\n}missing
3502Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231213_235433__82900.024.12980[455, 525]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231213_235433__829.json25.0missingmissingmissing
3503Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_004815__30500.016.7971[469, 458]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_004815__305.json55.0missing{\n "num_gpu": 99\n}missing
3504Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_004834__68830.019.67665[469, 545]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_004834__688.json90.0missing{\n "num_gpu": 99\n}missing
3505Apple-MacBook-Pro-M1weather_data_analyzeropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_222252__80540.012.96995[469, 339]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_222252__805.json95.0missing{\n "num_gpu": 99\n}missing
3506Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bAsIs1SHOTfalsefalse520231214_001047__10600.020.94790[138, 582]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__AsIs__1SHOT__20231214_001047__106.json0.0missingmissingmissing
3507Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bAsIs1SHOTfalsefalse520231225_011813__15600.04.043140[155, 52]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__AsIs__1SHOT__20231225_011813__156.json0.0missing{\n "num_gpu": 99\n}missing
3508Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bAsIs1SHOTfalsefalse520231225_011816__94600.03.391990[155, 40]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__AsIs__1SHOT__20231225_011816__946.json0.0missing{\n "num_gpu": 99\n}missing
3509Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231214_001026__19700.022.03280[155, 609]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231214_001026__197.json0.0missingmissingmissing
3510Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231225_011805__32000.04.341590[158, 58]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231225_011805__320.json0.0missing{\n "num_gpu": 99\n}missing
3511Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231225_011808__69400.03.939890[158, 50]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231225_011808__694.json0.0missing{\n "num_gpu": 99\n}missing
3512Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bInJulia1SHOTfalsefalse520231226_223358__77600.02.814360[158, 29]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__InJulia__1SHOT__20231226_223358__776.json0.0missing{\n "num_gpu": 99\n}missing
3513Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_001004__10600.019.4450[184, 527]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_001004__106.json50.0missingmissingmissing
3514Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_011744__36000.020.53120[197, 348]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_011744__360.json0.0missing{\n "num_gpu": 99\n}missing
3515Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTtruetrue520231225_011800__70000.016.53770[197, 275]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_011800__700.json50.0missing{\n "num_gpu": 99\n}missing
3516Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_223355__62100.019.97850[197, 339]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_223355__621.json0.0missing{\n "num_gpu": 99\n}missing
3517Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231214_000944__71400.024.45970[280, 617]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000944__714.json0.0missingmissingmissing
3518Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_011657__56800.039.39850[293, 492]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011657__568.json0.0missing{\n "num_gpu": 99\n}missing
3519Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_011723__74110.026.13961[293, 428]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011723__741.json60.0missing{\n "num_gpu": 99\n}missing
3520Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_223335__73300.016.84040[293, 96]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223335__733.json0.0missing{\n "num_gpu": 99\n}missing
3521Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_001129__33400.020.64361[11, 545]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_001129__334.json55.0missingmissingmissing
3522Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_012022__43600.032.7921[461, 507]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_012022__436.json55.0missing{\n "num_gpu": 99\n}missing
3523Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_012111__65810.048.85751[461, 771]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_012111__658.json60.0missing{\n "num_gpu": 99\n}missing
3524Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231226_223527__44400.062.30470[461, 988]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223527__444.json50.0missing{\n "num_gpu": 99\n}missing
3525Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTtruetrue520231214_001108__86610.020.53631[455, 435]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_001108__866.json60.0missingmissingmissing
3526Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_011907__69700.051.0670[458, 808]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_011907__697.json0.0missing{\n "num_gpu": 99\n}missing
3527Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_011949__18100.041.95740[458, 660]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_011949__181.json0.0missing{\n "num_gpu": 99\n}missing
3528Apple-MacBook-Pro-M1weather_data_analyzerorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_223425__68000.027.06790[458, 412]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_223425__680.json0.0missing{\n "num_gpu": 99\n}missing
3529Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_223840__63700.015.77770[138, 443]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_223840__637.json0.0missingmissingmissing
3530Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_223907__22800.026.25710[1, 749]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_223907__228.json0.0missingmissingmissing
3531Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_223934__83300.027.32450[1, 776]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_223934__833.json0.0missingmissingmissing
3532Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_015740__14200.04.687790[147, 169]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_015740__142.json0.0missing{\n "num_gpu": 99\n}missing
3533Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_015806__24600.026.40380[147, 952]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_015806__246.json0.0missing{\n "num_gpu": 99\n}missing
3534Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTtruetrue520231219_223809__38700.022.59970[1, 654]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_223809__387.json50.0missingmissingmissing
3535Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTtruetrue520231219_223824__22100.015.1011[1, 452]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_223824__221.json55.0missingmissingmissing
3536Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_015713__95200.010.98630[150, 410]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_015713__952.json0.0missing{\n "num_gpu": 99\n}missing
3537Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_015735__75300.021.7130[150, 793]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_015735__753.json0.0missing{\n "num_gpu": 99\n}missing
3538Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231226_225402__34300.021.02310[150, 767]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_225402__343.json0.0missing{\n "num_gpu": 99\n}missing
3539Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231219_223711__41100.017.58830[1, 514]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_223711__411.json50.0missingmissingmissing
3540Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231219_223724__62200.012.62060[1, 377]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_223724__622.json50.0missingmissingmissing
3541Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_015656__12900.05.435240[187, 193]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_015656__129.json0.0missing{\n "num_gpu": 99\n}missing
3542Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_015702__89500.06.336380[187, 228]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_015702__895.json0.0missing{\n "num_gpu": 99\n}missing
3543Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_225341__64700.028.31470[187, 1001]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_225341__647.json0.0missing{\n "num_gpu": 99\n}missing
3544Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_223616__49900.023.05830[1, 640]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_223616__499.json0.0missingmissingmissing
3545Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231219_223638__40500.021.27944[1, 595]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_223638__405.json70.0missingmissingmissing
3546Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_015644__46700.04.591220[271, 1]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015644__467.json0.0missing{\n "num_gpu": 99\n}missing
3547Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_015650__59800.06.328470[271, 211]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015650__598.json0.0missing{\n "num_gpu": 99\n}missing
3548Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_225312__59200.011.83170[271, 287]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225312__592.json0.0missing{\n "num_gpu": 99\n}missing
3549Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231219_224130__13800.021.22630[1, 566]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_224130__138.json50.0missingmissingmissing
3550Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231219_224150__47700.019.80110[1, 531]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_224150__477.json50.0missingmissingmissing
3551Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_015846__81800.01.507480[439, 1]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015846__818.json0.0missing{\n "num_gpu": 99\n}missing
3552Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_015852__13200.06.082360[439, 172]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015852__132.json0.0missing{\n "num_gpu": 99\n}missing
3553Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_225424__22400.011.80030[439, 377]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225424__224.json0.0missing{\n "num_gpu": 99\n}missing
3554Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_224028__82800.030.01080[1, 776]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_224028__828.json0.0missingmissingmissing
3555Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_224051__87510.022.7931[1, 605]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_224051__875.json60.0missingmissingmissing
3556Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_015817__40800.011.48970[436, 367]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_015817__408.json0.0missing{\n "num_gpu": 99\n}missing
3557Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_015844__87500.026.69790[436, 877]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_015844__875.json0.0missing{\n "num_gpu": 99\n}missing
3558Apple-MacBook-Pro-M1weather_data_analyzerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_225412__77300.010.31720[436, 325]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_225412__773.json0.0missing{\n "num_gpu": 99\n}missing
3559Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_001302__18300.030.60080[138, 831]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_001302__183.json0.0missingmissingmissing
3560Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2AsIs1SHOTtruetrue520231225_012741__76830.055.92154[163, 417]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_012741__768.json85.0missing{\n "num_gpu": 99\n}missing
3561Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_012827__18100.045.4640[163, 335]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_012827__181.json0.0missing{\n "num_gpu": 99\n}missing
3562Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231214_001231__24900.020.14940[155, 560]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_001231__249.json50.0missingmissingmissing
3563Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_012606__23840.049.71975[166, 368]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_012606__238.json95.0missing{\n "num_gpu": 99\n}missing
3564Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_012645__15240.038.55665[166, 280]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_012645__152.json95.0missing{\n "num_gpu": 99\n}missing
3565Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2InJulia1SHOTtruetrue520231226_223858__54530.054.13944[166, 399]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_223858__545.json85.0missing{\n "num_gpu": 99\n}missing
3566Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_001211__93200.018.32040[184, 497]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_001211__932.json0.0missingmissingmissing
3567Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_012433__78940.060.80315[205, 448]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_012433__789.json95.0missing{\n "num_gpu": 99\n}missing
3568Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_012516__36230.043.12074[205, 310]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_012516__362.json85.0missing{\n "num_gpu": 99\n}missing
3569Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_223804__21440.072.31955[205, 536]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_223804__214.json95.0missing{\n "num_gpu": 99\n}missing
3570Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231214_001153__39900.023.88050[280, 601]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_001153__399.json25.0missingmissingmissing
3571Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_012234__30400.083.16780[301, 425]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_012234__304.json50.0missing{\n "num_gpu": 99\n}missing
3572Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_012332__15030.057.58294[301, 404]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_012332__150.json85.0missing{\n "num_gpu": 99\n}missing
3573Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_223651__23340.084.05665[301, 448]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223651__233.json95.0missing{\n "num_gpu": 99\n}missing
3574Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_001401__28600.022.15830[11, 583]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_001401__286.json0.0missingmissingmissing
3575Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_013049__73700.031.70410[469, 172]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_013049__737.json50.0missing{\n "num_gpu": 99\n}missing
3576Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_013126__84600.036.88120[469, 212]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_013126__846.json50.0missing{\n "num_gpu": 99\n}missing
3577Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231226_224111__70610.079.26994[469, 534]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_224111__706.json75.0missing{\n "num_gpu": 99\n}missing
3578Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse520231214_001338__27400.036.49810[455, 820]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_001338__274.json0.0missingmissingmissing
3579Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_012925__62900.058.24510[466, 376]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_012925__629.json50.0missing{\n "num_gpu": 99\n}missing
3580Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_013018__30100.052.68040[466, 334]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_013018__301.json50.0missing{\n "num_gpu": 99\n}missing
3581Apple-MacBook-Pro-M1weather_data_analyzerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_223952__40230.053.46974[466, 339]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_223952__402.json85.0missing{\n "num_gpu": 99\n}missing
3582Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_221926__35600.029.45680[138, 804]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_221926__356.json0.0missingmissingmissing
3583Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_221943__66400.017.33090[1, 514]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_221943__664.json0.0missingmissingmissing
3584Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_222004__58500.021.34170[1, 621]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_222004__585.json0.0missingmissingmissing
3585Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_014824__35200.017.99210[162, 288]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_014824__352.json0.0missing{\n "num_gpu": 99\n}missing
3586Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_014843__66300.019.3740[162, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_014843__663.json0.0missing{\n "num_gpu": 99\n}missing
3587Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_221841__40200.022.33480[1, 647]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_221841__402.json0.0missingmissingmissing
3588Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231219_221856__77800.015.49980[1, 463]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_221856__778.json50.0missingmissingmissing
3589Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_014735__13010.024.55351[165, 400]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_014735__130.json60.0missing{\n "num_gpu": 99\n}missing
3590Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_014806__32930.030.56155[165, 501]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_014806__329.json90.0missing{\n "num_gpu": 99\n}missing
3591Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231226_224921__44140.017.93425[165, 287]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_224921__441.json95.0missing{\n "num_gpu": 99\n}missing
3592Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_221744__17300.017.01510[1, 499]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221744__173.json0.0missingmissingmissing
3593Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_221800__38800.015.08740[1, 446]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_221800__388.json25.0missingmissingmissing
3594Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_014655__74540.012.0785[206, 181]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_014655__745.json95.0missing{\n "num_gpu": 99\n}missing
3595Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_014710__49440.015.14465[206, 234]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_014710__494.json95.0missing{\n "num_gpu": 99\n}missing
3596Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_224903__94110.018.47891[206, 291]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_224903__941.json60.0missing{\n "num_gpu": 99\n}missing
3597Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_221646__91300.022.40570[1, 624]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_221646__913.json0.0missingmissingmissing
3598Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_221708__15100.022.07680[1, 613]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_221708__151.json0.0missingmissingmissing
3599Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_014624__26510.036.69741[302, 419]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_014624__265.json60.0missing{\n "num_gpu": 99\n}missing
3600Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_014643__69100.018.94240[302, 283]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_014643__691.json25.0missing{\n "num_gpu": 99\n}missing
3601Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_224844__30200.036.5180[302, 433]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_224844__302.json0.0missing{\n "num_gpu": 99\n}missing
3602Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_222224__47400.027.37630[1, 714]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222224__474.json50.0missingmissingmissing
3603Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_222233__22000.08.842170[1, 248]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_222233__220.json0.0missingmissingmissing
3604Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_014957__44510.026.08561[473, 374]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_014957__445.json60.0missing{\n "num_gpu": 99\n}missing
3605Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_015014__88240.017.05825[473, 225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_015014__882.json95.0missing{\n "num_gpu": 99\n}missing
3606Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_225002__87040.016.91785[473, 223]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225002__870.json95.0missing{\n "num_gpu": 99\n}missing
3607Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_222107__44600.032.46771[1, 833]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222107__446.json55.0missingmissingmissing
3608Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_222128__43700.021.25141[1, 567]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_222128__437.json55.0missingmissingmissing
3609Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_014907__84700.023.51980[471, 332]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014907__847.json0.0missing{\n "num_gpu": 99\n}missing
3610Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_014930__75940.023.6145[471, 334]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_014930__759.json95.0missing{\n "num_gpu": 99\n}missing
3611Apple-MacBook-Pro-M1weather_data_analyzersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231226_224945__33900.024.58920[471, 350]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_224945__339.json0.0missing{\n "num_gpu": 99\n}missing
3612Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrAsIs1SHOTfalsefalse520231214_000753__61000.019.48330[138, 544]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_000753__610.json0.0missingmissingmissing
3613Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrAsIs1SHOTfalsefalse520231225_011539__73600.08.047450[157, 434]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_011539__736.json0.0missing{\n "num_gpu": 99\n}missing
3614Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrAsIs1SHOTfalsefalse520231225_011546__36300.07.585810[157, 409]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_011546__363.json0.0missing{\n "num_gpu": 99\n}missing
3615Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTfalsefalse520231214_000734__12700.037.8660[155, 1005]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_000734__127.json0.0missingmissingmissing
3616Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTtruetrue520231225_011526__12200.07.112570[160, 385]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_011526__122.json50.0missing{\n "num_gpu": 99\n}missing
3617Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTtruetrue520231225_011530__44200.04.837470[160, 260]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_011530__442.json50.0missing{\n "num_gpu": 99\n}missing
3618Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrInJulia1SHOTfalsefalse520231226_223300__85800.05.399520[160, 290]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_223300__858.json0.0missing{\n "num_gpu": 99\n}missing
3619Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_000656__21200.010.36170[184, 274]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_000656__212.json0.0missingmissingmissing
3620Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_011512__31900.06.826810[197, 356]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_011512__319.json0.0missing{\n "num_gpu": 99\n}missing
3621Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_011518__19500.06.858050[197, 358]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_011518__195.json0.0missing{\n "num_gpu": 99\n}missing
3622Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231226_223255__53500.07.711290[197, 402]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_223255__535.json0.0missing{\n "num_gpu": 99\n}missing
3623Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_000645__67400.028.49780[280, 717]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_000645__674.json50.0missingmissingmissing
3624Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_011459__25100.09.181270[279, 310]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011459__251.json0.0missing{\n "num_gpu": 99\n}missing
3625Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_011505__70400.05.521490[279, 266]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_011505__704.json0.0missing{\n "num_gpu": 99\n}missing
3626Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_223247__82300.010.10470[279, 365]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_223247__823.json0.0missing{\n "num_gpu": 99\n}missing
3627Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_000920__65800.031.39780[11, 801]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_000920__658.json0.0missingmissingmissing
3628Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_011611__81500.010.55910[447, 476]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011611__815.json0.0missing{\n "num_gpu": 99\n}missing
3629Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_011617__44200.06.675590[447, 283]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_011617__442.json0.0missing{\n "num_gpu": 99\n}missing
3630Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_223318__26600.09.385550[447, 417]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_223318__266.json50.0missing{\n "num_gpu": 99\n}missing
3631Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_000848__22510.054.93451[455, 1222]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_000848__225.json60.0missingmissingmissing
3632Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_011553__24500.06.959090[445, 297]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_011553__245.json0.0missing{\n "num_gpu": 99\n}missing
3633Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_011600__64600.06.796050[445, 290]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_011600__646.json0.0missing{\n "num_gpu": 99\n}missing
3634Apple-MacBook-Pro-M1weather_data_analyzerstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_223309__79600.08.710170[445, 384]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_223309__796.json50.0missing{\n "num_gpu": 99\n}missing
3635Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestAsIs1SHOTfalsefalse520231213_235615__66500.030.90730[138, 839]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__AsIs__1SHOT__20231213_235615__665.json0.0missingmissingmissing
3636Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestAsIs1SHOTtruetrue520231225_005052__58220.012.11873[162, 370]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_005052__582.json75.0missing{\n "num_gpu": 99\n}missing
3637Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestAsIs1SHOTtruetrue520231225_005103__64420.010.48815[162, 318]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_005103__644.json85.0missing{\n "num_gpu": 99\n}missing
3638Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruetrue520231213_235544__48600.021.34020[155, 592]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231213_235544__486.json50.0missingmissingmissing
3639Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTfalsefalse520231225_005028__20400.011.77930[165, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_005028__204.json0.0missing{\n "num_gpu": 99\n}missing
3640Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruetrue520231225_005040__24310.011.60891[165, 355]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_005040__243.json60.0missing{\n "num_gpu": 99\n}missing
3641Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestInJulia1SHOTtruetrue520231226_222355__59120.016.27793[165, 503]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_222355__591.json75.0missing{\n "num_gpu": 99\n}missing
3642Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231213_235522__67200.015.88410[184, 430]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231213_235522__672.json50.0missingmissingmissing
3643Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_004959__93010.016.76391[206, 509]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_004959__930.json60.0missing{\n "num_gpu": 99\n}missing
3644Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_005016__85000.017.61940[206, 537]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_005016__850.json50.0missing{\n "num_gpu": 99\n}missing
3645Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_222339__48930.09.946975[206, 295]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_222339__489.json90.0missing{\n "num_gpu": 99\n}missing
3646Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231213_235507__28900.015.26820[280, 374]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235507__289.json25.0missingmissingmissing
3647Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_004929__93810.021.30531[302, 458]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004929__938.json60.0missing{\n "num_gpu": 99\n}missing
3648Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_004942__58210.012.47311[302, 355]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_004942__582.json60.0missing{\n "num_gpu": 99\n}missing
3649Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231226_222328__41310.016.69661[302, 328]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222328__413.json60.0missing{\n "num_gpu": 99\n}missing
3650Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231213_235729__85200.020.51050[11, 542]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235729__852.json25.0missingmissingmissing
3651Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_005152__91010.019.15911[473, 528]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_005152__910.json60.0missing{\n "num_gpu": 99\n}missing
3652Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_005215__30200.022.38860[473, 623]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_005215__302.json50.0missing{\n "num_gpu": 99\n}missing
3653Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_222423__13310.013.68711[473, 364]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222423__133.json60.0missing{\n "num_gpu": 99\n}missing
3654Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231213_235708__18000.052.93460[455, 1179]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231213_235708__180.json0.0missingmissingmissing
3655Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_005119__44700.016.26180[471, 441]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_005119__447.json50.0missing{\n "num_gpu": 99\n}missing
3656Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_005133__34710.013.56241[471, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_005133__347.json60.0missing{\n "num_gpu": 99\n}missing
3657Apple-MacBook-Pro-M1weather_data_analyzerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_222409__34330.013.70295[471, 364]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_222409__343.json90.0missing{\n "num_gpu": 99\n}missing
3658Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200243__38640.0003971.800015[143, 217]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200243__386.json95.0missingmissingmissing
3659Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200245__82240.000341.595935[143, 179]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200245__822.json95.0missingmissingmissing
3660Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200247__72140.00035051.579275[143, 186]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200247__721.json95.0missingmissingmissing
3661Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200249__56540.000431.803655[143, 239]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200249__565.json95.0missingmissingmissing
3662Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200250__95540.0003731.461625[143, 201]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200250__955.json95.0missingmissingmissing
3663Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200237__87930.0002871.269684[178, 132]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200237__879.json85.0missingmissingmissing
3664Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200238__28420.0003291.308055[178, 160]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200238__284.json85.0missingmissingmissing
3665Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200239__31840.00027651.012415[178, 125]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200239__318.json95.0missingmissingmissing
3666Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200240__86440.0002751.08835[178, 124]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200240__864.json95.0missingmissingmissing
3667Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200242__13040.0002841.242445[178, 130]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200242__130.json95.0missingmissingmissing
3668Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200230__33500.0003331.0730[255, 137]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200230__335.json0.0missingmissingmissing
3669Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200231__84740.0003631.197295[255, 157]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200231__847.json95.0missingmissingmissing
3670Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200233__26600.0003931.4310[255, 177]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200233__266.json0.0missingmissingmissing
3671Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200234__27940.0003691.230285[255, 161]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200234__279.json95.0missingmissingmissing
3672Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200235__40300.00033751.372630[255, 140]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200235__403.json0.0missingmissingmissing
3673Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200301__81500.0004771.590990[402, 184]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200301__815.json0.0missingmissingmissing
3674Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200302__91700.0003660.9640570[402, 110]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200302__917.json0.0missingmissingmissing
3675Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200303__45700.0003481.087780[402, 98]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200303__457.json0.0missingmissingmissing
3676Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200304__60030.0004141.345444[402, 142]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200304__600.json85.0missingmissingmissing
3677Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200306__53000.000451.323990[402, 166]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200306__530.json0.0missingmissingmissing
3678Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200252__82240.00049751.548034[401, 198]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200252__822.json90.0missingmissingmissing
3679Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200253__18250.00045251.46035[401, 168]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200253__182.json100.0missingmissingmissing
3680Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200255__73530.00041351.323544[401, 142]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200255__735.json85.0missingmissingmissing
3681Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200256__73500.00041951.381040[401, 146]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200256__735.json50.0missingmissingmissing
3682Apple-MacBook-Pro-M1weather_data_analyzergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200259__83520.0007452.728883[401, 363]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200259__835.json75.0missingmissingmissing
3683Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewInJulia1SHOTtruetrue520240201_075820__86730.0183251.19653[143, 563]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_075820__867.json80.0missingmissingmissing
3684Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewInJulia1SHOTtruetrue520240201_075911__47010.0186850.34681[143, 575]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_075911__470.json60.0missingmissingmissing
3685Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewInJulia1SHOTtruetrue520240201_075945__56040.0160733.93095[143, 488]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_075945__560.json95.0missingmissingmissing
3686Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewInJulia1SHOTtruetrue520240201_080025__43940.017340.22615[143, 529]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_080025__439.json95.0missingmissingmissing
3687Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewInJulia1SHOTtruetrue520240201_080107__47450.0174541.79045[143, 534]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_080107__474.json100.0missingmissingmissing
3688Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_075248__96140.006713.20215[178, 164]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_075248__961.json95.0missingmissingmissing
3689Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_075310__22350.0101821.74545[178, 280]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_075310__223.json100.0missingmissingmissing
3690Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_075320__67750.005779.381065[178, 133]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_075320__677.json100.0missingmissingmissing
3691Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_075340__84550.0069719.80265[178, 173]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_075340__845.json100.0missingmissingmissing
3692Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_075347__95810.005717.099461[178, 131]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_075347__958.json60.0missingmissingmissing
3693Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_074835__86750.0174337.64415[255, 496]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_074835__867.json100.0missingmissingmissing
3694Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_074917__71540.0182442.01695[255, 523]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_074917__715.json95.0missingmissingmissing
3695Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_074941__31500.0157523.82960[255, 440]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_074941__315.json25.0missingmissingmissing
3696Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_075031__80350.0148850.12965[255, 411]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_075031__803.json100.0missingmissingmissing
3697Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_075102__18150.0177930.64375[255, 508]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_075102__181.json100.0missingmissingmissing
3698Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_081304__44750.0194458.83855[402, 514]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_081304__447.json100.0missingmissingmissing
3699Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_081403__32750.0222659.24795[402, 608]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_081403__327.json100.0missingmissingmissing
3700Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_081442__36240.0189638.81595[402, 498]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_081442__362.json95.0missingmissingmissing
3701Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_081519__38640.0150937.15255[402, 369]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_081519__386.json95.0missingmissingmissing
3702Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_081549__77310.017729.4691[402, 456]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_081549__773.json60.0missingmissingmissing
3703Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_080551__99100.0166130.70650[401, 420]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_080551__991.json50.0missingmissingmissing
3704Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_080642__67350.0157450.61965[401, 391]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_080642__673.json100.0missingmissingmissing
3705Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_080720__49350.0184738.59315[401, 482]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_080720__493.json100.0missingmissingmissing
3706Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_080743__76050.0175422.66435[401, 451]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_080743__760.json100.0missingmissingmissing
3707Apple-MacBook-Pro-M1weather_data_analyzergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_080855__30940.016771.20954[401, 423]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/weather_data_analyzer/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_080855__309.json90.0missingmissingmissing
3708Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatAsIs1SHOTfalsefalse520231213_235851__12500.023.00230[138, 637]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__AsIs__1SHOT__20231213_235851__125.json0.0missingmissingmissing
3709Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatAsIs1SHOTtruetrue520231225_005937__11130.090.77455[156, 664]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_005937__111.json90.0missing{\n "num_gpu": 99\n}missing
3710Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatAsIs1SHOTtruetrue520231225_010026__35540.049.53625[156, 358]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_010026__355.json95.0missing{\n "num_gpu": 99\n}missing
3711Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231213_235828__99700.018.39430[155, 512]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231213_235828__997.json50.0missingmissingmissing
3712Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231225_005721__41050.077.15165[159, 563]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_005721__410.json100.0missing{\n "num_gpu": 99\n}missing
3713Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231225_005806__14920.043.16523[159, 306]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_005806__149.json75.0missing{\n "num_gpu": 99\n}missing
3714Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatInJulia1SHOTtruetrue520231226_222726__45640.070.18575[159, 514]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_222726__456.json95.0missing{\n "num_gpu": 99\n}missing
3715Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231213_235809__68700.017.330[184, 469]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231213_235809__687.json50.0missingmissingmissing
3716Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_005513__72020.050.49125[198, 354]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_005513__720.json85.0missing{\n "num_gpu": 99\n}missing
3717Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_005604__98930.050.45475[198, 354]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_005604__989.json90.0missing{\n "num_gpu": 99\n}missing
3718Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_222616__57640.038.80885[198, 267]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_222616__576.json95.0missing{\n "num_gpu": 99\n}missing
3719Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231213_235752__41200.023.32070[280, 587]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231213_235752__412.json0.0missingmissingmissing
3720Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_005335__72700.080.11620[290, 373]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_005335__727.json25.0missing{\n "num_gpu": 99\n}missing
3721Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_005423__53430.047.51034[290, 313]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_005423__534.json85.0missing{\n "num_gpu": 99\n}missing
3722Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231226_222537__37100.072.93590[290, 337]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_222537__371.json0.0missing{\n "num_gpu": 99\n}missing
3723Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231213_235940__17600.033.83780[11, 857]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231213_235940__176.json0.0missingmissingmissing
3724Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_010419__47200.090.16150[472, 587]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010419__472.json50.0missing{\n "num_gpu": 99\n}missing
3725Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_010516__90100.056.93080[472, 349]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_010516__901.json50.0missing{\n "num_gpu": 99\n}missing
3726Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231226_222913__25500.058.40820[472, 362]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_222913__255.json50.0missing{\n "num_gpu": 99\n}missing
3727Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTfalsefalse520231213_235906__52000.015.49020[455, 303]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231213_235906__520.json0.0missingmissingmissing
3728Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_010143__77300.076.34690[470, 489]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_010143__773.json25.0missing{\n "num_gpu": 99\n}missing
3729Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_010249__53500.065.97570[470, 415]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_010249__535.json25.0missing{\n "num_gpu": 99\n}missing
3730Apple-MacBook-Pro-M1weather_data_analyzeryi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_222814__70700.048.17110[470, 287]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/data_analysis/weather_data_analyzer/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_222814__707.json50.0missing{\n "num_gpu": 99\n}missing
3731Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructAsIs1SHOTfalsefalse320231214_001914__35600.07.715010[59, 233]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_001914__356.json0.0missingmissingmissing
3732Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructAsIs1SHOTfalsefalse320231225_021329__85000.06.143970[81, 103]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_021329__850.json0.0missing{\n "num_gpu": 99\n}missing
3733Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructAsIs1SHOTfalsefalse320231225_021348__54800.019.01130[81, 345]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_021348__548.json0.0missing{\n "num_gpu": 99\n}missing
3734Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructAsIs1SHOTfalsefalse320231225_161956__96000.08.124990[81, 141]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_161956__960.json0.0missing{\n "num_gpu": 99\n}missing
3735Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructAsIs1SHOTfalsefalse320231225_162000__11600.03.846260[81, 59]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_162000__116.json0.0missing{\n "num_gpu": 99\n}missing
3736Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231225_021310__93730.03.977432[83, 61]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_021310__937.json100.0missing{\n "num_gpu": 99\n}missing
3737Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruefalse320231225_021323__59400.013.02990[83, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_021323__594.json25.0missing{\n "num_gpu": 99\n}missing
3738Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231225_161936__19430.011.08982[83, 198]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_161936__194.json100.0missing{\n "num_gpu": 99\n}missing
3739Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231225_161948__23700.012.25072[83, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_161948__237.json75.0missing{\n "num_gpu": 99\n}missing
3740Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructInJulia1SHOTtruetrue320231226_230442__77030.012.69762[83, 228]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_230442__770.json100.0missing{\n "num_gpu": 99\n}missing
3741Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231225_021301__44530.09.0432[122, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_021301__445.json100.0missing{\n "num_gpu": 99\n}missing
3742Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse320231225_021306__47700.04.122510[122, 59]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_021306__477.json0.0missing{\n "num_gpu": 99\n}missing
3743Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231225_161920__78430.04.307762[122, 62]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_161920__784.json100.0missing{\n "num_gpu": 99\n}missing
3744Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231225_161924__19230.04.172532[122, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_161924__192.json100.0missing{\n "num_gpu": 99\n}missing
3745Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertAsk1SHOTtruetrue320231226_230429__47930.04.35222[122, 64]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_230429__479.json100.0missing{\n "num_gpu": 99\n}missing
3746Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231225_021248__31030.015.00762[205, 62]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021248__310.json100.0missing{\n "num_gpu": 99\n}missing
3747Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231225_021252__78230.04.832152[205, 58]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021252__782.json100.0missing{\n "num_gpu": 99\n}missing
3748Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse320231225_161902__54800.014.43420[205, 56]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161902__548.json0.0missing{\n "num_gpu": 99\n}missing
3749Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231225_161916__16130.013.24142[205, 215]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161916__161.json100.0missing{\n "num_gpu": 99\n}missing
3750Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue320231226_230424__57630.026.74642[205, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230424__576.json100.0missing{\n "num_gpu": 99\n}missing
3751Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue320231225_021501__19230.014.38372[387, 202]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021501__192.json100.0missing{\n "num_gpu": 99\n}missing
3752Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue320231225_021524__64730.022.25662[387, 342]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021524__647.json100.0missing{\n "num_gpu": 99\n}missing
3753Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue320231225_162059__81000.022.21642[387, 343]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162059__810.json75.0missing{\n "num_gpu": 99\n}missing
3754Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse320231225_162106__44700.06.761830[387, 64]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162106__447.json0.0missing{\n "num_gpu": 99\n}missing
3755Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse320231226_230520__50900.032.53270[387, 522]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230520__509.json25.0missing{\n "num_gpu": 99\n}missing
3756Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_021415__20000.026.58512[384, 422]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_021415__200.json75.0missing{\n "num_gpu": 99\n}missing
3757Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_021447__72030.032.02822[384, 516]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_021447__720.json100.0missing{\n "num_gpu": 99\n}missing
3758Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_162016__94330.016.02092[384, 231]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_162016__943.json100.0missing{\n "num_gpu": 99\n}missing
3759Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTtruetrue320231225_162037__63030.020.86272[384, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_162037__630.json100.0missing{\n "num_gpu": 99\n}missing
3760Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-instructJuliaRecapTask1SHOTfalsefalse320231226_230448__78800.05.88580[384, 52]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_230448__788.json0.0missing{\n "num_gpu": 99\n}missing
3761NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234015__79730.03.284072[0, 242]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234015__797.json100.0missing{\n "num_gpu": 99\n}missing
3762NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234018__25600.02.421732[0, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234018__256.json75.0missing{\n "num_gpu": 99\n}missing
3763NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234019__98030.01.605342[0, 119]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234019__980.json100.0missing{\n "num_gpu": 99\n}missing
3764NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234021__65330.01.309032[0, 97]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234021__653.json100.0missing{\n "num_gpu": 99\n}missing
3765NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234024__73530.03.209562[0, 237]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234024__735.json100.0missing{\n "num_gpu": 99\n}missing
3766NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_233952__61600.00.9195322[0, 68]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_233952__616.json75.0missing{\n "num_gpu": 99\n}missing
3767NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse320240131_233953__46600.00.8249120[0, 61]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_233953__466.json0.0missing{\n "num_gpu": 99\n}missing
3768NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_233954__55230.00.8238072[0, 61]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_233954__552.json100.0missing{\n "num_gpu": 99\n}missing
3769NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_233955__12830.01.256822[0, 93]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_233955__128.json100.0missing{\n "num_gpu": 99\n}missing
3770NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_233956__82430.00.9189762[0, 68]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_233956__824.json100.0missing{\n "num_gpu": 99\n}missing
3771NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_233932__70830.01.340952[0, 97]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233932__708.json100.0missing{\n "num_gpu": 99\n}missing
3772NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_233936__97130.03.261832[0, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233936__971.json100.0missing{\n "num_gpu": 99\n}missing
3773NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_233937__76200.00.8376750[0, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233937__762.json0.0missing{\n "num_gpu": 99\n}missing
3774NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320240131_233941__37600.04.15740[0, 295]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233941__376.json25.0missing{\n "num_gpu": 99\n}missing
3775NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_233943__59830.02.335552[0, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233943__598.json100.0missing{\n "num_gpu": 99\n}missing
3776NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234110__24530.01.508472[0, 109]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234110__245.json100.0missing{\n "num_gpu": 99\n}missing
3777NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234113__30400.02.870642[0, 207]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234113__304.json75.0missing{\n "num_gpu": 99\n}missing
3778NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320240131_234120__23500.06.575520[0, 468]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234120__235.json25.0missing{\n "num_gpu": 99\n}missing
3779NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234125__96630.05.315172[0, 379]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234125__966.json100.0missing{\n "num_gpu": 99\n}missing
3780NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234129__71430.04.193252[0, 300]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234129__714.json100.0missing{\n "num_gpu": 99\n}missing
3781NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234045__53730.03.085392[0, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234045__537.json100.0missing{\n "num_gpu": 99\n}missing
3782NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse320240131_234046__98100.00.6101920[0, 44]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234046__981.json25.0missing{\n "num_gpu": 99\n}missing
3783NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234048__81630.02.276922[0, 164]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234048__816.json100.0missing{\n "num_gpu": 99\n}missing
3784NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234053__74630.04.466062[0, 320]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234053__746.json100.0missing{\n "num_gpu": 99\n}missing
3785NVIDIA-RTX-4090-4xFloatWithUnitscodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234057__82930.03.917832[0, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234057__829.json100.0missing{\n "num_gpu": 99\n}missing
3786Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonAsIs1SHOTfalsefalse320231214_002029__25600.07.061510[59, 213]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_002029__256.json0.0missingmissingmissing
3787Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonAsIs1SHOTfalsefalse320231225_021754__38600.0107.6410[54, 1808]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_021754__386.json0.0missing{\n "num_gpu": 99\n}missing
3788Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonAsIs1SHOTfalsefalse320231225_021802__96400.07.874450[54, 141]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_021802__964.json0.0missing{\n "num_gpu": 99\n}missing
3789Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonAsIs1SHOTfalsefalse320231225_162151__28500.018.57870[54, 345]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_162151__285.json0.0missing{\n "num_gpu": 99\n}missing
3790Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonAsIs1SHOTtruefalse320231225_162158__98500.06.945790[54, 124]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_162158__985.json25.0missing{\n "num_gpu": 99\n}missing
3791Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231214_002022__83300.06.405110[75, 188]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_002022__833.json0.0missingmissingmissing
3792Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_021600__53000.015.34840[57, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_021600__530.json0.0missing{\n "num_gpu": 99\n}missing
3793Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_021606__95700.05.899970[57, 103]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_021606__957.json0.0missing{\n "num_gpu": 99\n}missing
3794Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_162127__95400.00.7497270[57, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_162127__954.json0.0missing{\n "num_gpu": 99\n}missing
3795Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonInJulia1SHOTfalsefalse320231225_162132__48300.04.862420[57, 84]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_162132__483.json0.0missing{\n "num_gpu": 99\n}missing
3796Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231214_002015__29800.06.458960[105, 179]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_002015__298.json0.0missingmissingmissing
3797Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_021544__29000.07.13570[59, 127]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_021544__290.json0.0missing{\n "num_gpu": 99\n}missing
3798Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_021545__82700.00.760090[59, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_021545__827.json0.0missing{\n "num_gpu": 99\n}missing
3799Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_162124__43300.05.806280[59, 102]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_162124__433.json0.0missing{\n "num_gpu": 99\n}missing
3800Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse320231225_162126__24600.02.652320[59, 41]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_162126__246.json0.0missing{\n "num_gpu": 99\n}missing
3801Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue320231214_002008__78500.015.98132[187, 431]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002008__785.json75.0missingmissingmissing
3802Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_021535__59000.011.53480[80, 15]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021535__590.json0.0missing{\n "num_gpu": 99\n}missing
3803Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_021537__85300.01.688720[80, 17]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021537__853.json0.0missing{\n "num_gpu": 99\n}missing
3804Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_162117__85100.010.85470[80, 1]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162117__851.json0.0missing{\n "num_gpu": 99\n}missing
3805Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse320231225_162118__55900.00.8653570[80, 1]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162118__559.json0.0missing{\n "num_gpu": 99\n}missing
3806Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue320231214_002110__47900.017.92572[11, 489]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_002110__479.json75.0missingmissingmissing
3807Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse320231225_021812__76000.07.404010[76, 127]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021812__760.json0.0missing{\n "num_gpu": 99\n}missing
3808Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse320231225_162202__71000.01.535710[76, 14]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162202__710.json0.0missing{\n "num_gpu": 99\n}missing
3809Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse320231225_162207__91000.04.518480[76, 72]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162207__910.json0.0missing{\n "num_gpu": 99\n}missing
3810Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231214_002052__88600.022.9950[376, 538]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_002052__886.json0.0missingmissingmissing
3811Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231225_021804__88300.01.68090[73, 17]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_021804__883.json0.0missing{\n "num_gpu": 99\n}missing
3812Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231225_162159__22600.01.681570[73, 17]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_162159__226.json0.0missing{\n "num_gpu": 99\n}missing
3813Apple-MacBook-Pro-M1FloatWithUnitscodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse320231225_162201__15700.01.510640[73, 14]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_162201__157.json0.0missing{\n "num_gpu": 99\n}missing
3814NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse320240131_234512__44400.06.331420[0, 229]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234512__444.json0.0missing{\n "num_gpu": 99\n}missing
3815NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse320240131_234517__80900.05.416080[0, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234517__809.json0.0missing{\n "num_gpu": 99\n}missing
3816NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234523__87130.06.139232[0, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234523__871.json100.0missing{\n "num_gpu": 99\n}missing
3817NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234530__36200.07.003322[0, 253]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234530__362.json75.0missing{\n "num_gpu": 99\n}missing
3818NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse320240131_234532__81300.02.324640[0, 84]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234532__813.json25.0missing{\n "num_gpu": 99\n}missing
3819NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse320240131_234416__47400.03.138120[0, 113]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234416__474.json0.0missing{\n "num_gpu": 99\n}missing
3820NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234421__85530.04.278512[0, 154]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234421__855.json100.0missing{\n "num_gpu": 99\n}missing
3821NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234425__74830.04.436212[0, 160]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234425__748.json100.0missing{\n "num_gpu": 99\n}missing
3822NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234429__22230.03.894342[0, 140]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234429__222.json100.0missing{\n "num_gpu": 99\n}missing
3823NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234435__50930.05.554222[0, 200]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234435__509.json100.0missing{\n "num_gpu": 99\n}missing
3824NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_234334__67400.02.599820[0, 93]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234334__674.json0.0missing{\n "num_gpu": 99\n}missing
3825NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_234339__19900.05.53612[0, 198]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234339__199.json75.0missing{\n "num_gpu": 99\n}missing
3826NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_234340__30200.00.8177760[0, 29]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234340__302.json0.0missing{\n "num_gpu": 99\n}missing
3827NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_234341__49900.00.7766980[0, 28]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234341__499.json0.0missing{\n "num_gpu": 99\n}missing
3828NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_234348__28130.07.477062[0, 269]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234348__281.json100.0missing{\n "num_gpu": 99\n}missing
3829NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320240131_234640__88000.02.566850[0, 91]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234640__880.json0.0missing{\n "num_gpu": 99\n}missing
3830NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320240131_234641__85700.00.1148190[0, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234641__857.json0.0missing{\n "num_gpu": 99\n}missing
3831NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234650__39930.09.207542[0, 327]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234650__399.json100.0missing{\n "num_gpu": 99\n}missing
3832NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234653__39700.03.448252[0, 123]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234653__397.json75.0missing{\n "num_gpu": 99\n}missing
3833NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234702__12400.09.136442[0, 324]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234702__124.json75.0missing{\n "num_gpu": 99\n}missing
3834NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234613__47830.05.334662[0, 190]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234613__478.json100.0missing{\n "num_gpu": 99\n}missing
3835NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234616__70030.02.270382[0, 81]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234616__700.json100.0missing{\n "num_gpu": 99\n}missing
3836NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234624__54130.08.44022[0, 300]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234624__541.json100.0missing{\n "num_gpu": 99\n}missing
3837NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320240131_234626__59700.01.848050[0, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234626__597.json0.0missing{\n "num_gpu": 99\n}missing
3838NVIDIA-RTX-4090-4xFloatWithUnitscodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234629__64830.02.797032[0, 100]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234629__648.json100.0missing{\n "num_gpu": 99\n}missing
3839NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KInJulia1SHOTtruetrue320240131_233525__21700.05.619892[0, 138]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_233525__217.json75.0missing{\n "num_gpu": 99\n}missing
3840NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KInJulia1SHOTtruefalse320240131_233537__69800.012.12030[0, 296]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_233537__698.json25.0missing{\n "num_gpu": 99\n}missing
3841NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse320240131_233547__79000.010.50650[0, 257]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_233547__790.json0.0missing{\n "num_gpu": 99\n}missing
3842NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KInJulia1SHOTtruefalse320240131_233555__56200.08.00710[0, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_233555__562.json25.0missing{\n "num_gpu": 99\n}missing
3843NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse320240131_233613__61800.017.21020[0, 421]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240131_233613__618.json0.0missing{\n "num_gpu": 99\n}missing
3844NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse320240131_233406__96200.010.50430[0, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_233406__962.json0.0missing{\n "num_gpu": 99\n}missing
3845NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse320240131_233414__37900.07.918250[0, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_233414__379.json0.0missing{\n "num_gpu": 99\n}missing
3846NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse320240131_233422__77700.08.052880[0, 198]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_233422__777.json0.0missing{\n "num_gpu": 99\n}missing
3847NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse320240131_233428__66300.05.942180[0, 146]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_233428__663.json0.0missing{\n "num_gpu": 99\n}missing
3848NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue320240131_233436__18830.08.328022[0, 205]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_233436__188.json100.0missing{\n "num_gpu": 99\n}missing
3849NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruefalse320240131_233223__11300.05.329170[0, 129]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233223__113.json25.0missing{\n "num_gpu": 99\n}missing
3850NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse320240131_233230__92500.07.108380[0, 172]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233230__925.json0.0missing{\n "num_gpu": 99\n}missing
3851NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse320240131_233238__13400.08.157890[0, 197]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233238__134.json0.0missing{\n "num_gpu": 99\n}missing
3852NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse320240131_233248__79600.09.749680[0, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233248__796.json0.0missing{\n "num_gpu": 99\n}missing
3853NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue320240131_233301__85230.013.04762[0, 315]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_233301__852.json100.0missing{\n "num_gpu": 99\n}missing
3854NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse320240131_233836__81200.09.646030[0, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233836__812.json0.0missing{\n "num_gpu": 99\n}missing
3855NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse320240131_233846__19400.010.20160[0, 242]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233846__194.json0.0missing{\n "num_gpu": 99\n}missing
3856NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue320240131_233856__67300.09.881982[0, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233856__673.json75.0missing{\n "num_gpu": 99\n}missing
3857NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue320240131_233905__93430.09.433772[0, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233905__934.json100.0missing{\n "num_gpu": 99\n}missing
3858NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse320240131_233914__82400.08.768730[0, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233914__824.json0.0missing{\n "num_gpu": 99\n}missing
3859NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse320240131_233719__11800.06.903710[0, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_233719__118.json0.0missing{\n "num_gpu": 99\n}missing
3860NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue320240131_233729__32630.010.22522[0, 248]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_233729__326.json100.0missing{\n "num_gpu": 99\n}missing
3861NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse320240131_233739__84400.09.270160[0, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_233739__844.json0.0missing{\n "num_gpu": 99\n}missing
3862NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse320240131_233745__58800.05.954810[0, 145]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_233745__588.json0.0missing{\n "num_gpu": 99\n}missing
3863NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse320240131_233753__87200.08.634070[0, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240131_233753__872.json0.0missing{\n "num_gpu": 99\n}missing
3864NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse320240131_232537__33000.014.1650[0, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_232537__330.json0.0missing{\n "num_gpu": 99\n}missing
3865NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_232601__89830.023.41412[0, 437]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_232601__898.json100.0missing{\n "num_gpu": 99\n}missing
3866NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_232613__46030.012.08642[0, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_232613__460.json100.0missing{\n "num_gpu": 99\n}missing
3867NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_232626__21830.013.35582[0, 250]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_232626__218.json100.0missing{\n "num_gpu": 99\n}missing
3868NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_232641__47030.014.84922[0, 278]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_232641__470.json100.0missing{\n "num_gpu": 99\n}missing
3869NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse320240131_232335__75600.012.45630[0, 231]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_232335__756.json25.0missing{\n "num_gpu": 99\n}missing
3870NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse320240131_232345__16100.09.081560[0, 170]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_232345__161.json25.0missing{\n "num_gpu": 99\n}missing
3871NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse320240131_232356__17000.011.07340[0, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_232356__170.json0.0missing{\n "num_gpu": 99\n}missing
3872NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_232405__10000.09.666212[0, 181]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_232405__100.json75.0missing{\n "num_gpu": 99\n}missing
3873NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse320240131_232414__65100.08.277320[0, 155]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_232414__651.json0.0missing{\n "num_gpu": 99\n}missing
3874NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_232121__99900.07.085412[0, 132]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_232121__999.json75.0missing{\n "num_gpu": 99\n}missing
3875NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_232130__39600.09.348550[0, 174]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_232130__396.json0.0missing{\n "num_gpu": 99\n}missing
3876NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_232139__99900.09.292650[0, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_232139__999.json0.0missing{\n "num_gpu": 99\n}missing
3877NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_232151__20900.011.50330[0, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_232151__209.json0.0missing{\n "num_gpu": 99\n}missing
3878NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_232207__73630.016.12092[0, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_232207__736.json100.0missing{\n "num_gpu": 99\n}missing
3879NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_233003__60900.010.78412[0, 199]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233003__609.json75.0missing{\n "num_gpu": 99\n}missing
3880NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320240131_233016__74100.012.9110[0, 239]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233016__741.json0.0missing{\n "num_gpu": 99\n}missing
3881NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_233034__38130.018.58062[0, 343]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233034__381.json100.0missing{\n "num_gpu": 99\n}missing
3882NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320240131_233047__36800.012.65580[0, 234]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233047__368.json0.0missing{\n "num_gpu": 99\n}missing
3883NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320240131_233053__69100.06.072850[0, 113]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_233053__691.json0.0missing{\n "num_gpu": 99\n}missing
3884NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_232807__53430.022.33092[0, 412]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_232807__534.json100.0missing{\n "num_gpu": 99\n}missing
3885NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320240131_232819__12900.011.89560[0, 220]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_232819__129.json0.0missing{\n "num_gpu": 99\n}missing
3886NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_232836__79730.017.58692[0, 324]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_232836__797.json100.0missing{\n "num_gpu": 99\n}missing
3887NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_232845__20100.08.830352[0, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_232845__201.json75.0missing{\n "num_gpu": 99\n}missing
3888NVIDIA-RTX-4090-4xFloatWithUnitscodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320240131_232854__11200.08.881910[0, 163]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_232854__112.json0.0missing{\n "num_gpu": 99\n}missing
3889NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234203__23730.00.5815422[0, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234203__237.json100.0missing{\n "num_gpu": 99\n}missing
3890NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234205__50400.01.81282[0, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234205__504.json75.0missing{\n "num_gpu": 99\n}missing
3891NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234207__57730.02.177082[0, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234207__577.json100.0missing{\n "num_gpu": 99\n}missing
3892NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234208__18730.00.5780962[0, 67]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234208__187.json100.0missing{\n "num_gpu": 99\n}missing
3893NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue320240131_234208__39230.00.5703192[0, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_234208__392.json100.0missing{\n "num_gpu": 99\n}missing
3894NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234155__56530.00.5212212[0, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234155__565.json100.0missing{\n "num_gpu": 99\n}missing
3895NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse320240131_234156__49800.01.775340[0, 205]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234156__498.json25.0missing{\n "num_gpu": 99\n}missing
3896NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234157__96700.00.5820172[0, 67]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234157__967.json75.0missing{\n "num_gpu": 99\n}missing
3897NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234158__69130.00.5907422[0, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234158__691.json100.0missing{\n "num_gpu": 99\n}missing
3898NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320240131_234200__39730.01.908942[0, 212]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_234200__397.json100.0missing{\n "num_gpu": 99\n}missing
3899NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_234141__99400.02.050460[0, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234141__994.json0.0missing{\n "num_gpu": 99\n}missing
3900NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_234142__37400.00.4938592[0, 58]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234142__374.json75.0missing{\n "num_gpu": 99\n}missing
3901NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_234144__92100.01.811760[0, 213]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234144__921.json0.0missing{\n "num_gpu": 99\n}missing
3902NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320240131_234145__60830.00.815662[0, 96]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234145__608.json100.0missing{\n "num_gpu": 99\n}missing
3903NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320240131_234146__92300.01.003170[0, 117]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234146__923.json0.0missing{\n "num_gpu": 99\n}missing
3904NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234247__70920.04.21512[0, 482]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234247__709.json91.6667missing{\n "num_gpu": 99\n}missing
3905NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234250__26730.02.116692[0, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234250__267.json100.0missing{\n "num_gpu": 99\n}missing
3906NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234252__77300.01.641692[0, 192]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234252__773.json75.0missing{\n "num_gpu": 99\n}missing
3907NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320240131_234254__74900.02.640530[0, 307]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234254__749.json25.0missing{\n "num_gpu": 99\n}missing
3908NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320240131_234257__70100.02.413832[0, 273]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_234257__701.json75.0missing{\n "num_gpu": 99\n}missing
3909NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234221__15430.00.6138432[0, 72]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234221__154.json100.0missing{\n "num_gpu": 99\n}missing
3910NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234221__42630.00.7489252[0, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234221__426.json100.0missing{\n "num_gpu": 99\n}missing
3911NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234222__25330.00.7410162[0, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234222__253.json100.0missing{\n "num_gpu": 99\n}missing
3912NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320240131_234223__44730.00.5720652[0, 67]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234223__447.json100.0missing{\n "num_gpu": 99\n}missing
3913NVIDIA-RTX-4090-4xFloatWithUnitscodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse320240131_234226__20100.03.262330[0, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_234226__201.json25.0missing{\n "num_gpu": 99\n}missing
3914Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse320231219_224341__22700.08.570560[1, 272]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_224341__227.json0.0missingmissingmissing
3915Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue320231225_023410__87030.048.45452[71, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_023410__870.json100.0missing{\n "num_gpu": 99\n}missing
3916Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue320231225_023458__64130.048.24092[71, 290]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_023458__641.json100.0missing{\n "num_gpu": 99\n}missing
3917Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue320231225_163805__21530.036.2832[71, 216]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_163805__215.json100.0missing{\n "num_gpu": 99\n}missing
3918Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue320231225_163841__36630.035.61272[71, 212]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_163841__366.json100.0missing{\n "num_gpu": 99\n}missing
3919Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_023255__42030.028.81662[74, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_023255__420.json100.0missing{\n "num_gpu": 99\n}missing
3920Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_023321__42930.025.88712[74, 150]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_023321__429.json100.0missing{\n "num_gpu": 99\n}missing
3921Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_163646__27730.043.15552[74, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_163646__277.json100.0missing{\n "num_gpu": 99\n}missing
3922Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_163728__51530.041.99052[74, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_163728__515.json100.0missing{\n "num_gpu": 99\n}missing
3923Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue320231226_231325__77130.032.88152[74, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_231325__771.json100.0missing{\n "num_gpu": 99\n}missing
3924Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_023131__88630.042.6512[115, 248]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023131__886.json100.0missing{\n "num_gpu": 99\n}missing
3925Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_023226__41900.053.65382[115, 316]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023226__419.json75.0missing{\n "num_gpu": 99\n}missing
3926Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_163531__76230.031.36562[115, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_163531__762.json100.0missing{\n "num_gpu": 99\n}missing
3927Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_163602__80430.030.82552[115, 176]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_163602__804.json100.0missing{\n "num_gpu": 99\n}missing
3928Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231226_231252__16430.042.04342[115, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231252__164.json100.0missing{\n "num_gpu": 99\n}missing
3929Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_023029__83530.069.0782[197, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023029__835.json100.0missing{\n "num_gpu": 99\n}missing
3930Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_023048__37830.019.10212[197, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023048__378.json100.0missing{\n "num_gpu": 99\n}missing
3931Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_163430__21200.048.27112[197, 105]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_163430__212.json75.0missing{\n "num_gpu": 99\n}missing
3932Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_163459__34530.028.9392[197, 149]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_163459__345.json100.0missing{\n "num_gpu": 99\n}missing
3933Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231210__87300.075.2132[197, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231210__873.json75.0missing{\n "num_gpu": 99\n}missing
3934Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_023705__52400.037.56562[403, 169]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_023705__524.json75.0missing{\n "num_gpu": 99\n}missing
3935Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_023735__21930.029.80912[403, 122]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_023735__219.json100.0missing{\n "num_gpu": 99\n}missing
3936Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164114__20030.040.83682[403, 190]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164114__200.json100.0missing{\n "num_gpu": 99\n}missing
3937Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164135__40430.020.92232[403, 68]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164135__404.json100.0missing{\n "num_gpu": 99\n}missing
3938Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231226_231439__30330.029.53772[403, 121]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231439__303.json100.0missing{\n "num_gpu": 99\n}missing
3939Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023550__70430.051.12492[401, 250]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023550__704.json100.0missing{\n "num_gpu": 99\n}missing
3940Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023627__21100.035.46692[401, 156]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023627__211.json75.0missing{\n "num_gpu": 99\n}missing
3941Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_163924__16100.043.122[401, 204]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_163924__161.json75.0missing{\n "num_gpu": 99\n}missing
3942Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164032__14330.068.55562[401, 357]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164032__143.json100.0missing{\n "num_gpu": 99\n}missing
3943Apple-MacBook-Pro-M1FloatWithUnitsdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231226_231409__52030.043.79222[401, 208]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231409__520.json100.0missing{\n "num_gpu": 99\n}missing
3944Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse320231226_232017__63200.07.325640[76, 282]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_232017__632.json25.0missing{\n "num_gpu": 99\n}missing
3945Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue320231227_110234__48900.07.340882[76, 282]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_110234__489.json75.0missing{\n "num_gpu": 99\n}missing
3946Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse320231227_110241__21700.06.553510[76, 251]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_110241__217.json25.0missing{\n "num_gpu": 99\n}missing
3947Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse320231227_110248__92500.06.689850[76, 256]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_110248__925.json25.0missing{\n "num_gpu": 99\n}missing
3948Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse320231226_232010__60000.01.272910[113, 38]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_232010__600.json0.0missing{\n "num_gpu": 99\n}missing
3949Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse320231227_110215__99100.01.832260[113, 61]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_110215__991.json0.0missing{\n "num_gpu": 99\n}missing
3950Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse320231227_110220__34200.05.3890[113, 201]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_110220__342.json25.0missing{\n "num_gpu": 99\n}missing
3951Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse320231227_110227__12100.06.305940[113, 237]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_110227__121.json0.0missing{\n "num_gpu": 99\n}missing
3952Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231226_232008__22600.08.677660[193, 184]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232008__226.json0.0missing{\n "num_gpu": 99\n}missing
3953Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231227_110207__57400.07.821990[193, 146]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110207__574.json0.0missing{\n "num_gpu": 99\n}missing
3954Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse320231227_110210__48500.02.817420[193, 87]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110210__485.json25.0missing{\n "num_gpu": 99\n}missing
3955Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse320231227_110213__81900.03.202430[193, 102]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110213__819.json25.0missing{\n "num_gpu": 99\n}missing
3956Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231226_232035__96300.09.024360[365, 293]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232035__963.json0.0missing{\n "num_gpu": 99\n}missing
3957Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse320231227_110319__28800.06.022110[365, 183]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110319__288.json25.0missing{\n "num_gpu": 99\n}missing
3958Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231227_110327__58900.08.331320[365, 268]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110327__589.json0.0missing{\n "num_gpu": 99\n}missing
3959Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231227_110335__36500.08.105140[365, 260]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_110335__365.json0.0missing{\n "num_gpu": 99\n}missing
3960Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse320231226_232026__38600.09.381190[362, 306]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_232026__386.json25.0missing{\n "num_gpu": 99\n}missing
3961Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse320231227_110300__37400.012.24850[362, 407]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_110300__374.json0.0missing{\n "num_gpu": 99\n}missing
3962Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruefalse320231227_110307__64200.06.865670[362, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_110307__642.json25.0missing{\n "num_gpu": 99\n}missing
3963Apple-MacBook-Pro-M1FloatWithUnitsdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse320231227_110313__98100.05.935430[362, 180]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_110313__981.json0.0missing{\n "num_gpu": 99\n}missing
3964Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestInJulia1SHOTtruetrue320240217_105623__49000.04.030072[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105623__490.json75.0missingmissingmissing
3965Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestInJulia1SHOTtruefalse320240217_105626__21100.02.671840[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105626__211.json25.0missingmissingmissing
3966Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestInJulia1SHOTtruetrue320240217_105627__68030.01.937542[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105627__680.json100.0missingmissingmissing
3967Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestInJulia1SHOTtruetrue320240217_105630__41630.02.388072[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105630__416.json100.0missingmissingmissing
3968Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestInJulia1SHOTtruetrue320240217_105632__70230.02.106752[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105632__702.json100.0missingmissingmissing
3969Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue320240217_105544__34030.02.510572[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105544__340.json100.0missingmissingmissing
3970Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse320240217_105546__31800.02.078740[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105546__318.json0.0missingmissingmissing
3971Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse320240217_105554__59700.07.481370[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105554__597.json25.0missingmissingmissing
3972Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue320240217_105558__96030.04.302752[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105558__960.json100.0missingmissingmissing
3973Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse320240217_105600__68900.02.157550[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105600__689.json25.0missingmissingmissing
3974Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue320240217_105513__88400.02.781830[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105513__884.json50.0missingmissingmissing
3975Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue320240217_105515__41430.02.251992[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105515__414.json100.0missingmissingmissing
3976Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue320240217_105517__99730.02.63332[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105517__997.json100.0missingmissingmissing
3977Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue320240217_105520__85500.02.017710[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105520__855.json50.0missingmissingmissing
3978Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse320240217_113821__20200.08.086810[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_113821__202.json25.0missingmissingmissing
3979Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue320240217_105728__97230.02.478892[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105728__972.json100.0missingmissingmissing
3980Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue320240217_105731__55400.02.611642[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105731__554.json75.0missingmissingmissing
3981Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue320240217_105736__83300.05.393692[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105736__833.json75.0missingmissingmissing
3982Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse320240217_105745__21000.08.042750[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105745__210.json25.0missingmissingmissing
3983Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse320240217_105747__25500.02.311480[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_105747__255.json0.0missingmissingmissing
3984Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue320240217_105653__82700.02.574060[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105653__827.json50.0missingmissingmissing
3985Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse320240217_105656__82000.03.361080[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105656__820.json25.0missingmissingmissing
3986Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse320240217_105704__11500.07.710040[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105704__115.json25.0missingmissingmissing
3987Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue320240217_105707__31100.03.367782[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105707__311.json75.0missingmissingmissing
3988Apple-MacBook-Pro-M1FloatWithUnitsgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse320240217_105710__56100.03.169320[0, 0]0.13.0-DEV21.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105710__561.json25.0missingmissingmissing
3989Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse320240223_222713__51200.013.1830[0, 202]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_222713__512.json0.0missingmissingmissing
3990Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse320240223_222730__52600.016.85490[0, 258]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_222730__526.json0.0missingmissingmissing
3991Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse320240223_222748__60700.017.4180[0, 268]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_222748__607.json0.0missingmissingmissing
3992Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse320240223_222808__61300.020.00380[0, 310]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_222808__613.json0.0missingmissingmissing
3993Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KInJulia1SHOTtruefalse320240223_222815__51000.06.998280[0, 106]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_222815__510.json25.0missingmissingmissing
3994Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse320240223_222529__98100.03.395130[0, 48]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_222529__981.json0.0missingmissingmissing
3995Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse320240223_222532__52700.03.202810[0, 48]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_222532__527.json0.0missingmissingmissing
3996Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse320240223_222536__35800.03.306980[0, 50]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_222536__358.json0.0missingmissingmissing
3997Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse320240223_222539__97900.03.190560[0, 50]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_222539__979.json0.0missingmissingmissing
3998Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse320240223_222542__35100.03.636550[0, 53]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_222542__351.json0.0missingmissingmissing
3999Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse320240223_222353__47700.016.17870[0, 247]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_222353__477.json0.0missingmissingmissing
4000Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse320240223_222407__33600.013.43910[0, 203]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_222407__336.json0.0missingmissingmissing
4001Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse320240223_222425__40300.018.20850[0, 278]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_222425__403.json0.0missingmissingmissing
4002Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse320240223_222448__10800.022.95970[0, 355]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_222448__108.json0.0missingmissingmissing
4003Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse320240223_222509__57400.021.01840[0, 320]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_222509__574.json0.0missingmissingmissing
4004Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse320240223_223314__64000.020.36230[0, 310]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_223314__640.json0.0missingmissingmissing
4005Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse320240223_223335__92700.020.57980[0, 313]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_223335__927.json0.0missingmissingmissing
4006Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse320240223_223359__37400.023.67840[0, 356]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_223359__374.json0.0missingmissingmissing
4007Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse320240223_223418__95000.019.34590[0, 295]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_223418__950.json0.0missingmissingmissing
4008Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse320240223_223438__52600.019.83430[0, 298]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_223438__526.json0.0missingmissingmissing
4009Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse320240223_223005__57600.023.85010[0, 360]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_223005__576.json0.0missingmissingmissing
4010Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse320240223_223020__68300.014.93330[0, 225]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_223020__683.json0.0missingmissingmissing
4011Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse320240223_223037__28400.017.61530[0, 265]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_223037__284.json0.0missingmissingmissing
4012Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse320240223_223056__25100.018.98430[0, 289]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_223056__251.json0.0missingmissingmissing
4013Apple-MacBook-Pro-M1FloatWithUnitsgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse320240223_223113__33500.016.50770[0, 250]0.13.0-DEV21.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_223113__335.json0.0missingmissingmissing
4014Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboAsIs1SHOTfalsefalse320231213_201351__33700.0003084.353730[67, 183]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_201351__337.json0.0missingmissingmissing
4015Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboAsIs1SHOTfalsefalse320231225_190047__86000.000444.910490[67, 271]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_190047__860.json0.0missingmissingmissing
4016Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboAsIs1SHOTfalsefalse320231225_190050__69700.0002512.746170[67, 145]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_190050__697.json0.0missingmissingmissing
4017Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo--optimAsIs1SHOTfalsefalse320231215_192409__75600.04.995570[67, 219]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_192409__756.json0.00.5missing0.5
4018Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboInJulia1SHOTtruetrue320231213_201347__29930.00027654.150192[70, 161]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_201347__299.json100.0missingmissingmissing
4019Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboInJulia1SHOTtruetrue320231225_190039__86630.00035454.082412[70, 213]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_190039__866.json100.0missingmissingmissing
4020Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboInJulia1SHOTtruetrue320231225_190042__87230.00025552.82692[70, 147]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_190042__872.json100.0missingmissingmissing
4021Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboInJulia1SHOTtruetrue320231227_193534__25030.00049855.656652[70, 309]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_193534__250.json100.0missingmissingmissing
4022Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboInJulia1SHOTtruetrue320231227_193538__56230.00030053.638712[70, 177]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_193538__562.json100.0missingmissingmissing
4023Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo--optimInJulia1SHOTtruetrue320231215_192404__55830.05.436842[70, 213]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_192404__558.json100.00.5missing0.5
4024Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue320231213_201342__25930.00035854.591262[105, 204]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_201342__259.json100.0missingmissingmissing
4025Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue320231225_190030__18630.0002161.933242[105, 109]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_190030__186.json100.0missingmissingmissing
4026Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue320231225_190035__23630.00050255.285582[105, 300]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_190035__236.json100.0missingmissingmissing
4027Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue320231227_193524__73630.0002642.76052[105, 141]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_193524__736.json100.0missingmissingmissing
4028Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue320231227_193529__11130.0004174.629742[105, 243]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_193529__111.json100.0missingmissingmissing
4029Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue320231215_192359__27930.03.799892[105, 147]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_192359__279.json100.00.5missing0.5
4030Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue320231213_201338__49930.0002132.427762[174, 84]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201338__499.json100.0missingmissingmissing
4031Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue320231225_190026__53830.0003062.797072[174, 146]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190026__538.json100.0missingmissingmissing
4032Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue320231225_190027__13130.0002161.848582[174, 86]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190027__131.json100.0missingmissingmissing
4033Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue320231227_193519__95830.0002071.923742[174, 80]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193519__958.json100.0missingmissingmissing
4034Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue320231227_193521__15230.00021151.848812[174, 83]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193521__152.json100.0missingmissingmissing
4035Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTtruetrue320231215_192355__58430.03.078382[174, 98]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192355__584.json100.00.5missing0.5
4036Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse320231213_201354__10700.00021051.196080[328, 31]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201354__107.json0.0missingmissingmissing
4037Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse320231225_190054__51700.00024351.121870[328, 53]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190054__517.json0.0missingmissingmissing
4038Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse320231225_190056__38900.000321.823030[328, 104]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190056__389.json0.0missingmissingmissing
4039Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue320231227_193547__26930.00051654.476382[328, 235]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193547__269.json100.0missingmissingmissing
4040Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue320231227_193552__28030.00054.173072[328, 224]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193552__280.json100.0missingmissingmissing
4041Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue320231215_192420__55330.06.023032[328, 254]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192420__553.json100.00.5missing0.5
4042Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse320231213_201353__65000.00024451.710820[327, 54]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_201353__650.json0.0missingmissingmissing
4043Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse320231225_190051__85000.00025351.544760[327, 60]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_190051__850.json0.0missingmissingmissing
4044Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse320231225_190053__71500.0002491.227390[327, 57]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_190053__715.json0.0missingmissingmissing
4045Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue320231227_193541__75730.00036152.721182[327, 132]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_193541__757.json100.0missingmissingmissing
4046Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turboJuliaRecapTask1SHOTtruetrue320231227_193543__87230.0003031.844762[327, 93]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_193543__872.json100.0missingmissingmissing
4047Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo--optimJuliaRecapTask1SHOTtruetrue320231215_192414__57630.04.424052[327, 154]0.10.0-DEV21.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_192414__576.json100.00.5missing0.5
4048Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125InJulia1SHOTtruetrue320240201_200315__70930.0002361.044642[70, 134]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200315__709.json100.0missingmissingmissing
4049Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125InJulia1SHOTtruetrue320240201_200316__20530.00028551.360132[70, 167]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200316__205.json100.0missingmissingmissing
4050Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125InJulia1SHOTtruetrue320240201_200317__25130.00024651.314352[70, 141]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200317__251.json100.0missingmissingmissing
4051Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125InJulia1SHOTtruetrue320240201_200319__86330.00029751.307822[70, 175]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200319__863.json100.0missingmissingmissing
4052Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125InJulia1SHOTtruetrue320240201_200320__59800.0002631.236632[70, 152]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200320__598.json75.0missingmissingmissing
4053Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue320240201_200311__44830.0001170.5610622[105, 43]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200311__448.json100.0missingmissingmissing
4054Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue320240201_200312__69530.00011550.5979082[105, 42]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200312__695.json100.0missingmissingmissing
4055Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue320240201_200312__73830.00011550.7433672[105, 42]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200312__738.json100.0missingmissingmissing
4056Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue320240201_200313__61030.000120.5597382[105, 45]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200313__610.json100.0missingmissingmissing
4057Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue320240201_200314__90630.0001230.5765692[105, 47]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200314__906.json100.0missingmissingmissing
4058Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue320240201_200307__98830.00023551.068382[174, 99]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200307__988.json100.0missingmissingmissing
4059Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue320240201_200308__77130.0002191.035012[174, 88]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200308__771.json100.0missingmissingmissing
4060Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue320240201_200309__31030.0002430.8745832[174, 104]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200309__310.json100.0missingmissingmissing
4061Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue320240201_200310__28630.00022350.8975252[174, 91]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200310__286.json100.0missingmissingmissing
4062Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue320240201_200310__75730.0002130.813952[174, 84]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200310__757.json100.0missingmissingmissing
4063Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue320240201_200327__59330.0002721.001982[328, 72]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200327__593.json100.0missingmissingmissing
4064Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse320240201_200328__11900.0002570.8306020[328, 62]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200328__119.json0.0missingmissingmissing
4065Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue320240201_200329__56500.0002990.8583252[328, 90]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200329__565.json75.0missingmissingmissing
4066Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue320240201_200330__41630.00029750.870692[328, 89]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200330__416.json100.0missingmissingmissing
4067Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue320240201_200331__94030.000260.8502382[328, 64]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200331__940.json100.0missingmissingmissing
4068Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue320240201_200321__24430.000270.7451482[327, 71]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200321__244.json100.0missingmissingmissing
4069Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue320240201_200322__48830.0002760.931912[327, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200322__488.json100.0missingmissingmissing
4070Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue320240201_200324__55230.0002762.557852[327, 75]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200324__552.json100.0missingmissingmissing
4071Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue320240201_200325__46530.0003150.9657592[327, 101]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200325__465.json100.0missingmissingmissing
4072Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue320240201_200326__77730.00035551.241212[327, 128]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200326__777.json100.0missingmissingmissing
4073Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106AsIs1SHOTfalsefalse320231213_201407__59800.0004093.78330[67, 171]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_201407__598.json0.0missingmissingmissing
4074Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106AsIs1SHOTfalsefalse320231225_190107__43400.0003232.102740[67, 128]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_190107__434.json0.0missingmissingmissing
4075Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106AsIs1SHOTfalsefalse320231225_190109__21400.0002811.732710[67, 107]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_190109__214.json0.0missingmissingmissing
4076Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse320231215_192433__15500.06.345350[67, 183]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_192433__155.json0.00.9missing0.1
4077Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106InJulia1SHOTtruetrue320231213_201403__72530.0003582.801462[70, 144]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_201403__725.json100.0missingmissingmissing
4078Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106InJulia1SHOTtruetrue320231225_190103__22030.00031.614242[70, 115]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_190103__220.json100.0missingmissingmissing
4079Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106InJulia1SHOTtruetrue320231225_190105__54230.0003461.918922[70, 138]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_190105__542.json100.0missingmissingmissing
4080Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106InJulia1SHOTtruetrue320231227_193602__30700.0003442.969722[70, 137]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_193602__307.json75.0missingmissingmissing
4081Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106InJulia1SHOTtruetrue320231227_193607__12830.0003864.552632[70, 158]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_193607__128.json100.0missingmissingmissing
4082Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue320231215_192426__60130.02.126912[70, 103]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_192426__601.json100.00.9missing0.1
4083Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue320231213_201400__66230.0001992.227222[105, 47]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_201400__662.json100.0missingmissingmissing
4084Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTfalsefalse320231225_190100__23700.0001991.01750[105, 47]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_190100__237.json0.0missingmissingmissing
4085Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue320231225_190101__28030.0001891.022582[105, 42]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_190101__280.json100.0missingmissingmissing
4086Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue320231227_193558__68330.0001992.172182[105, 47]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_193558__683.json100.0missingmissingmissing
4087Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue320231227_193559__71530.0001991.251062[105, 47]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_193559__715.json100.0missingmissingmissing
4088Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue320231215_192424__17130.01.316952[105, 42]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_192424__171.json100.00.9missing0.1
4089Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue320231213_201358__61630.0003643.234842[174, 95]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201358__616.json100.0missingmissingmissing
4090Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue320231225_190057__43330.0003761.630062[174, 101]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190057__433.json100.0missingmissingmissing
4091Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue320231225_190059__22230.0003561.571232[174, 91]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190059__222.json100.0missingmissingmissing
4092Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue320231227_193554__38330.0003522.043772[174, 89]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193554__383.json100.0missingmissingmissing
4093Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue320231227_193556__13630.0003741.859662[174, 100]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193556__136.json100.0missingmissingmissing
4094Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue320231215_192423__79130.02.561382[174, 84]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192423__791.json100.00.9missing0.1
4095Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse320231213_201411__63400.0005822.806820[328, 127]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201411__634.json0.0missingmissingmissing
4096Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse320231225_190112__10200.0004641.160830[328, 68]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190112__102.json0.0missingmissingmissing
4097Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue320231225_190114__16700.000561.493532[328, 116]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190114__167.json75.0missingmissingmissing
4098Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse320231227_193612__79000.0005742.20950[328, 123]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193612__790.json0.0missingmissingmissing
4099Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue320231227_193614__80300.0005662.060642[328, 119]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193614__803.json75.0missingmissingmissing
4100Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTtruetrue320231215_192438__47830.02.842462[328, 161]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192438__478.json100.00.9missing0.1
4101Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue320231213_201408__79530.0004511.126632[327, 62]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_201408__795.json100.0missingmissingmissing
4102Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue320231225_190110__30030.0004611.539712[327, 67]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_190110__300.json100.0missingmissingmissing
4103Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue320231225_190111__88330.0004651.063782[327, 69]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_190111__883.json100.0missingmissingmissing
4104Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue320231227_193608__20230.0004631.252942[327, 68]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_193608__202.json100.0missingmissingmissing
4105Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue320231227_193610__71600.0004571.780522[327, 65]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_193610__716.json75.0missingmissingmissing
4106Apple-MacBook-Pro-M1FloatWithUnitsgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue320231215_192435__98830.02.490612[327, 63]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_192435__988.json100.00.9missing0.1
4107Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewInJulia1SHOTfalsefalse320240201_082319__60000.0108716.03180[70, 339]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_082319__600.json0.0missingmissingmissing
4108Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewInJulia1SHOTtruetrue320240201_082354__22630.0136335.58252[70, 431]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_082354__226.json100.0missingmissingmissing
4109Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewInJulia1SHOTfalsefalse320240201_082416__21800.0088321.3120[70, 271]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_082416__218.json0.0missingmissingmissing
4110Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewInJulia1SHOTfalsefalse320240201_082448__54000.014832.08170[70, 470]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_082448__540.json0.0missingmissingmissing
4111Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewInJulia1SHOTtruetrue320240201_082526__15030.0154638.30072[70, 492]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_082526__150.json100.0missingmissingmissing
4112Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue320240201_082028__43230.002554.080432[105, 50]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_082028__432.json100.0missingmissingmissing
4113Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue320240201_082032__99430.002673.876642[105, 54]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_082032__994.json100.0missingmissingmissing
4114Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertAsk1SHOTfalsefalse320240201_082036__63000.002553.842670[105, 50]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_082036__630.json0.0missingmissingmissing
4115Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue320240201_082041__24830.002555.224622[105, 50]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_082041__248.json100.0missingmissingmissing
4116Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue320240201_082046__63230.002554.509152[105, 50]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_082046__632.json100.0missingmissingmissing
4117Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse320240201_081820__71600.013228.06140[174, 382]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_081820__716.json0.0missingmissingmissing
4118Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue320240201_081841__17530.0104120.91572[174, 289]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_081841__175.json100.0missingmissingmissing
4119Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse320240201_081913__74200.010832.37460[174, 302]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_081913__742.json0.0missingmissingmissing
4120Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse320240201_081950__52200.0122736.48330[174, 351]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_081950__522.json0.0missingmissingmissing
4121Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue320240201_082005__66330.0061515.21442[174, 147]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_082005__663.json100.0missingmissingmissing
4122Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapCoTTask1SHOTfalsefalse320240201_083445__83200.0155231.66960[328, 408]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_083445__832.json0.0missingmissingmissing
4123Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue320240201_083511__11030.0109326.28332[328, 255]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_083511__110.json100.0missingmissingmissing
4124Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue320240201_083546__88030.0162734.38352[328, 433]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_083546__880.json100.0missingmissingmissing
4125Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue320240201_083554__31730.006528.007352[328, 108]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_083554__317.json100.0missingmissingmissing
4126Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue320240201_083635__57730.0172340.69892[328, 465]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_083635__577.json100.0missingmissingmissing
4127Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue320240201_082917__61630.0186361.39722[327, 512]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_082917__616.json100.0missingmissingmissing
4128Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapTask1SHOTfalsefalse320240201_082942__23800.0185124.72490[327, 508]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_082942__238.json0.0missingmissingmissing
4129Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapTask1SHOTfalsefalse320240201_083008__83500.0140126.39240[327, 358]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_083008__835.json0.0missingmissingmissing
4130Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapTask1SHOTfalsefalse320240201_083052__97100.0149444.11010[327, 389]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_083052__971.json0.0missingmissingmissing
4131Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue320240201_083128__23030.0171935.07462[327, 464]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_083128__230.json100.0missingmissingmissing
4132Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewAsIs1SHOTfalsefalse320231213_201530__51500.0106622.04850[67, 333]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_201530__515.json0.0missingmissingmissing
4133Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewAsIs1SHOTtruetrue320231225_190219__68530.0082914.29292[67, 254]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_190219__685.json100.0missingmissingmissing
4134Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewAsIs1SHOTfalsefalse320231225_190239__77700.0130320.68110[67, 412]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_190239__777.json0.0missingmissingmissing
4135Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-preview--optimAsIs1SHOTtruetrue320231215_192552__80730.031.0092[67, 260]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_192552__807.json100.00.1missing0.9
4136Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewInJulia1SHOTtruetrue320231213_201508__45230.010928.32592[70, 340]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_201508__452.json100.0missingmissingmissing
4137Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewInJulia1SHOTtruetrue320231225_190147__51630.0087112.13392[70, 267]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_190147__516.json100.0missingmissingmissing
4138Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewInJulia1SHOTtruetrue320231225_190204__18630.0093716.91922[70, 289]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_190204__186.json100.0missingmissingmissing
4139Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewInJulia1SHOTtruetrue320231227_193802__31630.0080514.3392[70, 245]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_193802__316.json100.0missingmissingmissing
4140Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewInJulia1SHOTtruetrue320231227_193830__63330.007927.53342[70, 240]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_193830__633.json100.0missingmissingmissing
4141Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-preview--optimInJulia1SHOTtruetrue320231215_192521__61930.018.31452[70, 228]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_192521__619.json100.00.1missing0.9
4142Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue320231213_201439__67330.0053110.00112[105, 142]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_201439__673.json100.0missingmissingmissing
4143Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertAsk1SHOTfalsefalse320231225_190132__59600.003723.970220[105, 89]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_190132__596.json0.0missingmissingmissing
4144Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue320231225_190135__37930.002643.322052[105, 53]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_190135__379.json100.0missingmissingmissing
4145Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue320231227_193744__22730.002645.444112[105, 53]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_193744__227.json100.0missingmissingmissing
4146Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue320231227_193748__78030.002643.444072[105, 53]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_193748__780.json100.0missingmissingmissing
4147Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue320231215_192502__68230.06.948332[105, 53]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_192502__682.json100.00.1missing0.9
4148Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse320231213_201429__67600.0085518.51540[174, 227]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201429__676.json0.0missingmissingmissing
4149Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse320231225_190119__45200.00575.100330[174, 132]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190119__452.json0.0missingmissingmissing
4150Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse320231225_190128__89700.008228.558820[174, 216]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190128__897.json0.0missingmissingmissing
4151Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue320231227_193650__77830.016535.43612[174, 492]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193650__778.json100.0missingmissingmissing
4152Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue320231227_193739__10930.0097848.7492[174, 268]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193739__109.json100.0missingmissingmissing
4153Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue320231215_192455__90330.017.11082[174, 158]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192455__903.json100.00.1missing0.9
4154Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue320231213_201557__51930.0083510.52552[328, 169]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201557__519.json100.0missingmissingmissing
4155Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapCoTTask1SHOTfalsefalse320231225_190312__93000.0082311.79340[328, 165]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190312__930.json0.0missingmissingmissing
4156Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapCoTTask1SHOTfalsefalse320231225_190323__79000.0114410.92810[328, 272]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190323__790.json0.0missingmissingmissing
4157Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapCoTTask1SHOTfalsefalse320231227_193910__40600.0106912.3640[328, 247]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193910__406.json0.0missingmissingmissing
4158Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue320231227_193935__61230.0112924.74662[328, 267]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193935__612.json100.0missingmissingmissing
4159Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue320231215_192636__17530.016.69992[328, 209]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192636__175.json100.00.1missing0.9
4160Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue320231213_201546__20730.0107716.09272[327, 250]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_201546__207.json100.0missingmissingmissing
4161Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue320231225_190253__92030.0110413.51992[327, 259]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_190253__920.json100.0missingmissingmissing
4162Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue320231225_190300__70330.008376.531292[327, 170]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_190300__703.json100.0missingmissingmissing
4163Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue320231227_193844__34830.010213.87562[327, 231]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_193844__348.json100.0missingmissingmissing
4164Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue320231227_193858__82330.0123314.11492[327, 302]0.10.0-DEV21.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_193858__823.json100.0missingmissingmissing
4165Apple-MacBook-Pro-M1FloatWithUnitsgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue320231215_192619__77630.027.41662[327, 308]0.10.0-DEV21.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_192619__776.json100.00.1missing0.9
4166Apple-MacBook-Pro-M1FloatWithUnitsllama2AsIs1SHOTfalsefalse320231214_001428__45100.08.665140[59, 263]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__AsIs__1SHOT__20231214_001428__451.json0.0missingmissingmissing
4167Apple-MacBook-Pro-M1FloatWithUnitsllama2AsIs1SHOTfalsefalse320231225_015950__63000.08.262820[59, 250]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__AsIs__1SHOT__20231225_015950__630.json0.0missing{\n "num_gpu": 99\n}missing
4168Apple-MacBook-Pro-M1FloatWithUnitsllama2AsIs1SHOTfalsefalse320231225_015959__76700.09.258430[1, 292]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__AsIs__1SHOT__20231225_015959__767.json0.0missing{\n "num_gpu": 99\n}missing
4169Apple-MacBook-Pro-M1FloatWithUnitsllama2AsIs1SHOTfalsefalse320231225_160522__79800.011.60750[59, 352]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__AsIs__1SHOT__20231225_160522__798.json0.0missing{\n "num_gpu": 99\n}missing
4170Apple-MacBook-Pro-M1FloatWithUnitsllama2AsIs1SHOTfalsefalse320231225_160527__93100.05.221150[1, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__AsIs__1SHOT__20231225_160527__931.json0.0missing{\n "num_gpu": 99\n}missing
4171Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTtruetrue320231225_015934__63000.06.596752[75, 194]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_015934__630.json75.0missing{\n "num_gpu": 99\n}missing
4172Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTfalsefalse320231225_015941__41700.07.122350[1, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_015941__417.json0.0missing{\n "num_gpu": 99\n}missing
4173Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTfalsefalse320231225_160503__19100.08.525430[75, 255]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_160503__191.json0.0missing{\n "num_gpu": 99\n}missing
4174Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTfalsefalse320231225_160510__34400.06.887980[1, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231225_160510__344.json0.0missing{\n "num_gpu": 99\n}missing
4175Apple-MacBook-Pro-M1FloatWithUnitsllama2InJulia1SHOTfalsefalse320231226_225753__71000.08.339190[75, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__InJulia__1SHOT__20231226_225753__710.json0.0missing{\n "num_gpu": 99\n}missing
4176Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_015923__86700.09.055260[105, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_015923__867.json0.0missing{\n "num_gpu": 99\n}missing
4177Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_015927__91300.04.807970[1, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_015927__913.json0.0missing{\n "num_gpu": 99\n}missing
4178Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_160449__66800.06.321910[105, 177]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_160449__668.json0.0missing{\n "num_gpu": 99\n}missing
4179Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231225_160455__44900.05.415660[1, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_160455__449.json0.0missing{\n "num_gpu": 99\n}missing
4180Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertAsk1SHOTfalsefalse320231226_225744__74300.06.663440[105, 190]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_225744__743.json0.0missing{\n "num_gpu": 99\n}missing
4181Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_015905__28600.013.01680[205, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015905__286.json0.0missing{\n "num_gpu": 99\n}missing
4182Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_015914__42700.08.770960[1, 266]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_015914__427.json0.0missing{\n "num_gpu": 99\n}missing
4183Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_160437__48900.013.16350[205, 201]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160437__489.json0.0missing{\n "num_gpu": 99\n}missing
4184Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231225_160443__94900.06.143490[1, 190]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160443__949.json0.0missing{\n "num_gpu": 99\n}missing
4185Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaExpertCoTTask1SHOTfalsefalse320231226_225738__95300.014.92320[205, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225738__953.json0.0missing{\n "num_gpu": 99\n}missing
4186Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTfalsefalse320231225_020048__51600.013.90860[11, 384]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020048__516.json0.0missing{\n "num_gpu": 99\n}missing
4187Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTfalsefalse320231225_020101__17200.012.66020[1, 356]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020101__172.json0.0missing{\n "num_gpu": 99\n}missing
4188Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTfalsefalse320231225_160628__75400.015.44150[11, 426]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160628__754.json0.0missing{\n "num_gpu": 99\n}missing
4189Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTfalsefalse320231225_160644__46500.016.16720[1, 451]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160644__465.json0.0missing{\n "num_gpu": 99\n}missing
4190Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapCoTTask1SHOTtruefalse320231226_225837__89900.015.87510[11, 442]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225837__899.json25.0missing{\n "num_gpu": 99\n}missing
4191Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231225_020021__94600.022.23840[376, 518]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_020021__946.json0.0missing{\n "num_gpu": 99\n}missing
4192Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231225_020034__75000.013.19680[1, 371]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_020034__750.json0.0missing{\n "num_gpu": 99\n}missing
4193Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231225_160550__82500.023.07340[376, 542]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_160550__825.json0.0missing{\n "num_gpu": 99\n}missing
4194Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTtruefalse320231225_160612__31400.022.1250[1, 603]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_160612__314.json25.0missing{\n "num_gpu": 99\n}missing
4195Apple-MacBook-Pro-M1FloatWithUnitsllama2JuliaRecapTask1SHOTfalsefalse320231226_225821__86300.028.83160[376, 691]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_225821__863.json0.0missing{\n "num_gpu": 99\n}missing
4196Apple-MacBook-Pro-M1FloatWithUnitsmagicoderAsIs1SHOTfalsefalse320231214_002147__79700.08.086620[59, 244]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__AsIs__1SHOT__20231214_002147__797.json0.0missingmissingmissing
4197Apple-MacBook-Pro-M1FloatWithUnitsmagicoderAsIs1SHOTfalsefalse320231225_021903__15400.05.50320[73, 175]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__AsIs__1SHOT__20231225_021903__154.json0.0missing{\n "num_gpu": 99\n}missing
4198Apple-MacBook-Pro-M1FloatWithUnitsmagicoderAsIs1SHOTfalsefalse320231225_021908__56900.05.901020[73, 189]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__AsIs__1SHOT__20231225_021908__569.json0.0missing{\n "num_gpu": 99\n}missing
4199Apple-MacBook-Pro-M1FloatWithUnitsmagicoderAsIs1SHOTfalsefalse320231225_162306__98900.05.011370[73, 159]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__AsIs__1SHOT__20231225_162306__989.json0.0missing{\n "num_gpu": 99\n}missing
4200Apple-MacBook-Pro-M1FloatWithUnitsmagicoderAsIs1SHOTfalsefalse320231225_162314__41800.07.987490[73, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__AsIs__1SHOT__20231225_162314__418.json0.0missing{\n "num_gpu": 99\n}missing
4201Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231225_021852__90730.04.726712[75, 148]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_021852__907.json100.0missing{\n "num_gpu": 99\n}missing
4202Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231225_021857__83330.05.116092[75, 161]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_021857__833.json100.0missing{\n "num_gpu": 99\n}missing
4203Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231225_162250__52830.09.058022[75, 297]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_162250__528.json100.0missing{\n "num_gpu": 99\n}missing
4204Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTfalsefalse320231225_162301__22000.010.40380[75, 342]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231225_162301__220.json0.0missing{\n "num_gpu": 99\n}missing
4205Apple-MacBook-Pro-M1FloatWithUnitsmagicoderInJulia1SHOTtruetrue320231226_230546__40430.07.477492[75, 242]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__InJulia__1SHOT__20231226_230546__404.json100.0missing{\n "num_gpu": 99\n}missing
4206Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231225_021840__35230.05.101722[115, 155]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_021840__352.json100.0missing{\n "num_gpu": 99\n}missing
4207Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231225_021847__82800.07.183372[115, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_021847__828.json75.0missing{\n "num_gpu": 99\n}missing
4208Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruefalse320231225_162235__82200.07.17220[115, 228]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_162235__822.json25.0missing{\n "num_gpu": 99\n}missing
4209Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231225_162241__34630.06.238692[115, 195]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_162241__346.json100.0missing{\n "num_gpu": 99\n}missing
4210Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertAsk1SHOTtruetrue320231226_230539__75830.07.014792[115, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_230539__758.json100.0missing{\n "num_gpu": 99\n}missing
4211Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_021823__84630.010.93162[197, 135]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021823__846.json100.0missing{\n "num_gpu": 99\n}missing
4212Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_021835__63730.011.12912[197, 338]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021835__637.json100.0missing{\n "num_gpu": 99\n}missing
4213Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_162219__13230.012.22752[197, 180]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162219__132.json100.0missing{\n "num_gpu": 99\n}missing
4214Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231225_162227__60130.08.260062[197, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162227__601.json100.0missing{\n "num_gpu": 99\n}missing
4215Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaExpertCoTTask1SHOTtruetrue320231226_230531__30730.011.27262[197, 155]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230531__307.json100.0missing{\n "num_gpu": 99\n}missing
4216Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_021939__61530.013.03682[379, 368]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021939__615.json100.0missing{\n "num_gpu": 99\n}missing
4217Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_021943__48430.03.584932[379, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021943__484.json100.0missing{\n "num_gpu": 99\n}missing
4218Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_162337__15230.06.628542[379, 166]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162337__152.json100.0missing{\n "num_gpu": 99\n}missing
4219Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruetrue320231225_162344__97330.07.315492[379, 188]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162344__973.json100.0missing{\n "num_gpu": 99\n}missing
4220Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapCoTTask1SHOTtruefalse320231226_230604__31000.010.55810[379, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230604__310.json25.0missing{\n "num_gpu": 99\n}missing
4221Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_021918__92030.09.917512[376, 270]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_021918__920.json100.0missing{\n "num_gpu": 99\n}missing
4222Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_021926__47030.07.66062[376, 198]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_021926__470.json100.0missing{\n "num_gpu": 99\n}missing
4223Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_162323__49430.09.028642[376, 244]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_162323__494.json100.0missing{\n "num_gpu": 99\n}missing
4224Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231225_162330__27430.07.222732[376, 185]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_162330__274.json100.0missing{\n "num_gpu": 99\n}missing
4225Apple-MacBook-Pro-M1FloatWithUnitsmagicoderJuliaRecapTask1SHOTtruetrue320231226_230554__71730.07.437472[376, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_230554__717.json100.0missing{\n "num_gpu": 99\n}missing
4226Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue320231227_175906__96730.011.69842[75, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175906__967.json100.0missing{\n "num_gpu": 99\n}missing
4227Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue320231227_175916__26030.010.08512[75, 193]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175916__260.json100.0missing{\n "num_gpu": 99\n}missing
4228Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue320231227_175925__72730.08.529542[75, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_175925__727.json100.0missing{\n "num_gpu": 99\n}missing
4229Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse320231227_175830__75200.013.64560[115, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175830__752.json25.0missing{\n "num_gpu": 99\n}missing
4230Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue320231227_175840__62330.010.25062[115, 192]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175840__623.json100.0missing{\n "num_gpu": 99\n}missing
4231Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue320231227_175854__36930.013.71442[115, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_175854__369.json100.0missing{\n "num_gpu": 99\n}missing
4232Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue320231227_175753__83430.015.69182[197, 288]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175753__834.json100.0missing{\n "num_gpu": 99\n}missing
4233Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse320231227_175804__67200.010.70050[197, 190]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175804__672.json25.0missing{\n "num_gpu": 99\n}missing
4234Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue320231227_175816__13130.012.53442[197, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_175816__131.json100.0missing{\n "num_gpu": 99\n}missing
4235Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue320231227_180021__40530.013.62142[379, 227]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180021__405.json100.0missing{\n "num_gpu": 99\n}missing
4236Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue320231227_180034__89830.012.79452[379, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180034__898.json100.0missing{\n "num_gpu": 99\n}missing
4237Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue320231227_180052__11730.017.31432[379, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180052__117.json100.0missing{\n "num_gpu": 99\n}missing
4238Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue320231227_175941__48930.016.42352[376, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175941__489.json100.0missing{\n "num_gpu": 99\n}missing
4239Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue320231227_175958__55130.017.00072[376, 292]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_175958__551.json100.0missing{\n "num_gpu": 99\n}missing
4240Apple-MacBook-Pro-M1FloatWithUnitsmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue320231227_180008__31130.09.380312[376, 145]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180008__311.json100.0missing{\n "num_gpu": 99\n}missing
4241Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumAsIs1SHOTfalsefalse320231213_201905__25100.0027966846.15940[71, 322]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__AsIs__1SHOT__20231213_201905__251.json0.0missingmissingmissing
4242Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumAsIs1SHOTfalsefalse320231225_190539__83800.002230385.622350[71, 252]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__AsIs__1SHOT__20231225_190539__838.json0.0missingmissingmissing
4243Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumAsIs1SHOTfalsefalse320231225_190549__79200.0037351210.49670[71, 438]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__AsIs__1SHOT__20231225_190549__792.json0.0missingmissingmissing
4244Apple-MacBook-Pro-M1FloatWithUnitsmistral-medium--optimAsIs1SHOTfalsefalse320231215_192941__29200.037.41640[71, 243]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__AsIs__1SHOT__20231215_192941__292.json0.00.9missing0.3
4245Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumInJulia1SHOTtruetrue320231213_201819__27730.001976926.60212[73, 220]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__InJulia__1SHOT__20231213_201819__277.json100.0missingmissingmissing
4246Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumInJulia1SHOTtruetrue320231225_190526__73030.002243875.558152[73, 253]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__InJulia__1SHOT__20231225_190526__730.json100.0missingmissingmissing
4247Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumInJulia1SHOTtruetrue320231225_190533__78230.00246236.255572[73, 280]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__InJulia__1SHOT__20231225_190533__782.json100.0missingmissingmissing
4248Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumInJulia1SHOTtruetrue320231227_194146__60930.0020173516.81572[73, 225]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__InJulia__1SHOT__20231227_194146__609.json100.0missingmissingmissing
4249Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumInJulia1SHOTtruetrue320231227_194201__46030.0017665613.99662[73, 194]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__InJulia__1SHOT__20231227_194201__460.json100.0missingmissingmissing
4250Apple-MacBook-Pro-M1FloatWithUnitsmistral-medium--optimInJulia1SHOTtruetrue320231215_192903__97630.033.22482[73, 217]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__InJulia__1SHOT__20231215_192903__976.json100.00.9missing0.3
4251Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertAsk1SHOTtruetrue320231213_201752__44130.0018664722.98692[113, 193]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_201752__441.json100.0missingmissingmissing
4252Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertAsk1SHOTtruetrue320231225_190517__83630.001898834.682022[113, 197]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_190517__836.json100.0missingmissingmissing
4253Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertAsk1SHOTtruetrue320231225_190521__98230.00159953.639592[113, 160]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_190521__982.json100.0missingmissingmissing
4254Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertAsk1SHOTtruetrue320231227_194112__89030.0017289417.87722[113, 176]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_194112__890.json100.0missingmissingmissing
4255Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertAsk1SHOTtruetrue320231227_194130__89930.0022628817.34052[113, 242]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_194130__899.json100.0missingmissingmissing
4256Apple-MacBook-Pro-M1FloatWithUnitsmistral-medium--optimJuliaExpertAsk1SHOTtruetrue320231215_192830__47330.032.1632[113, 184]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_192830__473.json100.00.9missing0.3
4257Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue320231213_201729__55730.0028806934.5222[195, 291]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201729__557.json100.0missingmissingmissing
4258Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue320231225_190503__59230.00230637.279732[195, 220]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190503__592.json100.0missingmissingmissing
4259Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue320231225_190512__95730.003511718.830632[195, 369]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190512__957.json100.0missingmissingmissing
4260Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue320231227_194046__86130.003002047.041042[195, 306]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194046__861.json100.0missingmissingmissing
4261Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaExpertCoTTask1SHOTtruetrue320231227_194054__46730.003341827.93112[195, 348]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194054__467.json100.0missingmissingmissing
4262Apple-MacBook-Pro-M1FloatWithUnitsmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue320231215_192758__18230.040.47222[195, 274]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192758__182.json100.00.9missing0.3
4263Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue320231213_202030__72430.0033370336.88882[376, 287]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202030__724.json100.0missingmissingmissing
4264Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue320231225_190632__82600.0042673818.23172[376, 402]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190632__826.json75.0missingmissingmissing
4265Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue320231225_190731__27130.0052543658.56682[376, 524]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190731__271.json100.0missingmissingmissing
4266Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue320231227_194248__38430.002665564.7262[376, 204]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194248__384.json100.0missingmissingmissing
4267Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapCoTTask1SHOTtruetrue320231227_194253__96930.002697924.763772[376, 208]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194253__969.json100.0missingmissingmissing
4268Apple-MacBook-Pro-M1FloatWithUnitsmistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue320231215_193133__99930.047.08762[376, 295]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193133__999.json100.00.9missing0.3
4269Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapTask1SHOTtruetrue320231213_201953__78030.0037738847.95972[373, 342]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_201953__780.json100.0missingmissingmissing
4270Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapTask1SHOTtruetrue320231225_190558__30830.004186479.013182[373, 393]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_190558__308.json100.0missingmissingmissing
4271Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapTask1SHOTtruetrue320231225_190613__63530.0044938914.90392[373, 431]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_190613__635.json100.0missingmissingmissing
4272Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapTask1SHOTtruetrue320231227_194220__29830.0036929819.77382[373, 332]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_194220__298.json100.0missingmissingmissing
4273Apple-MacBook-Pro-M1FloatWithUnitsmistral-mediumJuliaRecapTask1SHOTtruetrue320231227_194244__75400.0059662723.04672[373, 613]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_194244__754.json75.0missingmissingmissing
4274Apple-MacBook-Pro-M1FloatWithUnitsmistral-medium--optimJuliaRecapTask1SHOTtruetrue320231215_193045__93830.064.32612[373, 416]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_193045__938.json100.00.9missing0.3
4275Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallAsIs1SHOTfalsefalse320231213_201642__96400.000477915.422470[70, 223]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__AsIs__1SHOT__20231213_201642__964.json0.0missingmissingmissing
4276Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallAsIs1SHOTfalsefalse320231225_190430__19800.000281971.864710[70, 122]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__AsIs__1SHOT__20231225_190430__198.json0.0missingmissingmissing
4277Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallAsIs1SHOTfalsefalse320231225_190433__58600.000384792.535950[70, 175]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__AsIs__1SHOT__20231225_190433__586.json0.0missingmissingmissing
4278Apple-MacBook-Pro-M1FloatWithUnitsmistral-small--optimAsIs1SHOTfalsefalse320231215_192708__14600.02.779190[70, 164]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__AsIs__1SHOT__20231215_192708__146.json0.00.9missing0.3
4279Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallInJulia1SHOTtruetrue320231213_201637__16330.0006538047.365282[72, 313]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__InJulia__1SHOT__20231213_201637__163.json100.0missingmissingmissing
4280Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallInJulia1SHOTtruetrue320231225_190423__28030.00067514413.74252[72, 324]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__InJulia__1SHOT__20231225_190423__280.json100.0missingmissingmissing
4281Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallInJulia1SHOTtruetrue320231225_190428__33730.0007430444.929662[72, 359]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__InJulia__1SHOT__20231225_190428__337.json100.0missingmissingmissing
4282Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallInJulia1SHOTtruetrue320231227_194016__13230.0004986043.21522[72, 233]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__InJulia__1SHOT__20231227_194016__132.json100.0missingmissingmissing
4283Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallInJulia1SHOTtruetrue320231227_194020__43130.0006712644.361342[72, 322]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__InJulia__1SHOT__20231227_194020__431.json100.0missingmissingmissing
4284Apple-MacBook-Pro-M1FloatWithUnitsmistral-small--optimInJulia1SHOTtruetrue320231215_192705__68330.05.670722[72, 363]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__InJulia__1SHOT__20231215_192705__683.json100.00.9missing0.3
4285Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertAsk1SHOTtruefalse320231213_201629__93100.0004248984.293080[114, 181]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_201629__931.json25.0missingmissingmissing
4286Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertAsk1SHOTtruefalse320231225_190406__76400.0003860982.265490[114, 161]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_190406__764.json25.0missingmissingmissing
4287Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertAsk1SHOTtruetrue320231225_190409__23130.0003899783.129842[114, 163]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_190409__231.json100.0missingmissingmissing
4288Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertAsk1SHOTtruetrue320231227_194011__99030.0003705782.141682[114, 153]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_194011__990.json100.0missingmissingmissing
4289Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertAsk1SHOTtruetrue320231227_194013__46330.0003356581.936812[114, 135]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_194013__463.json100.0missingmissingmissing
4290Apple-MacBook-Pro-M1FloatWithUnitsmistral-small--optimJuliaExpertAsk1SHOTtruetrue320231215_192700__76530.02.676592[114, 194]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_192700__765.json100.00.9missing0.3
4291Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertCoTTask1SHOTtruetrue320231213_201624__23430.0006499656.339722[195, 270]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201624__234.json100.0missingmissingmissing
4292Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertCoTTask1SHOTtruetrue320231225_190400__71130.0006732453.959812[195, 282]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190400__711.json100.0missingmissingmissing
4293Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertCoTTask1SHOTtruetrue320231225_190403__17230.0006111653.426812[195, 250]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190403__172.json100.0missingmissingmissing
4294Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertCoTTask1SHOTtruefalse320231227_194004__26800.0006965254.170720[195, 294]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194004__268.json25.0missingmissingmissing
4295Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaExpertCoTTask1SHOTtruefalse320231227_194008__94700.0007586054.380710[195, 326]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194008__947.json25.0missingmissingmissing
4296Apple-MacBook-Pro-M1FloatWithUnitsmistral-small--optimJuliaExpertCoTTask1SHOTtruetrue320231215_192657__20730.03.59162[195, 271]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192657__207.json100.00.9missing0.3
4297Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapCoTTask1SHOTtruetrue320231213_201654__62930.000725043.492752[380, 247]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201654__629.json100.0missingmissingmissing
4298Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapCoTTask1SHOTfalsefalse320231225_190451__76600.001037385.67290[380, 408]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190451__766.json0.0missingmissingmissing
4299Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapCoTTask1SHOTtruefalse320231225_190456__16000.00086864.615150[380, 321]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190456__160.json25.0missingmissingmissing
4300Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapCoTTask1SHOTtruetrue320231227_194031__29130.000610582.763542[380, 188]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194031__291.json100.0missingmissingmissing
4301Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapCoTTask1SHOTfalsefalse320231227_194039__40500.001322567.466970[380, 555]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194039__405.json0.0missingmissingmissing
4302Apple-MacBook-Pro-M1FloatWithUnitsmistral-small--optimJuliaRecapCoTTask1SHOTfalsefalse320231215_192717__87200.03.878730[380, 287]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192717__872.json0.00.9missing0.3
4303Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapTask1SHOTtruetrue320231213_201651__52400.001210698.599872[378, 498]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_201651__524.json75.0missingmissingmissing
4304Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapTask1SHOTtruefalse320231225_190438__43600.0009429665.646820[378, 360]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_190438__436.json25.0missingmissingmissing
4305Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapTask1SHOTtruefalse320231225_190445__49700.001090417.121840[378, 436]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_190445__497.json25.0missingmissingmissing
4306Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapTask1SHOTtruetrue320231227_194024__33030.0007955264.03532[378, 284]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_194024__330.json100.0missingmissingmissing
4307Apple-MacBook-Pro-M1FloatWithUnitsmistral-smallJuliaRecapTask1SHOTtruetrue320231227_194028__56630.0008129864.041162[378, 293]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_194028__566.json100.0missingmissingmissing
4308Apple-MacBook-Pro-M1FloatWithUnitsmistral-small--optimJuliaRecapTask1SHOTtruefalse320231215_192713__87500.05.116860[378, 384]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_192713__875.json25.00.9missing0.3
4309Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyAsIs1SHOTfalsefalse320231213_201610__32300.0001352814.565830[70, 277]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__AsIs__1SHOT__20231213_201610__323.json0.0missingmissingmissing
4310Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyAsIs1SHOTfalsefalse320231225_190342__91400.0001176142.208260[70, 238]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__AsIs__1SHOT__20231225_190342__914.json0.0missingmissingmissing
4311Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyAsIs1SHOTfalsefalse320231225_190344__25400.0001081012.040380[70, 217]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__AsIs__1SHOT__20231225_190344__254.json0.0missingmissingmissing
4312Apple-MacBook-Pro-M1FloatWithUnitsmistral-tiny--optimAsIs1SHOTfalsefalse320231215_192646__11100.02.908390[70, 342]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__AsIs__1SHOT__20231215_192646__111.json0.00.9missing0.3
4313Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyInJulia1SHOTtruetrue320231213_201605__48330.0001043042.960032[72, 208]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__InJulia__1SHOT__20231213_201605__483.json100.0missingmissingmissing
4314Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyInJulia1SHOTtruetrue320231225_190337__33830.0001265012.358892[72, 257]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__InJulia__1SHOT__20231225_190337__338.json100.0missingmissingmissing
4315Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyInJulia1SHOTtruetrue320231225_190339__58530.0001468862.678322[72, 302]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__InJulia__1SHOT__20231225_190339__585.json100.0missingmissingmissing
4316Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyInJulia1SHOTtruetrue320231227_193947__71830.000100682.129272[72, 200]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__InJulia__1SHOT__20231227_193947__718.json100.0missingmissingmissing
4317Apple-MacBook-Pro-M1FloatWithUnitsmistral-tiny--optimInJulia1SHOTtruetrue320231215_192643__68030.03.362612[72, 394]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__InJulia__1SHOT__20231215_192643__680.json100.00.9missing0.3
4318Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertAsk1SHOTtruetrue320231213_201602__48135.673e-50.9629792[114, 90]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_201602__481.json100.0missingmissingmissing
4319Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertAsk1SHOTtruetrue320231225_190333__32836.4884e-51.126892[114, 108]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_190333__328.json100.0missingmissingmissing
4320Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertAsk1SHOTtruetrue320231225_190334__86234.5405e-50.8277382[114, 65]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_190334__862.json100.0missingmissingmissing
4321Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertAsk1SHOTtruetrue320231227_193944__39634.3593e-50.6672172[114, 61]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_193944__396.json100.0missingmissingmissing
4322Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertAsk1SHOTtruetrue320231227_193945__27934.5858e-50.7780972[114, 66]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_193945__279.json100.0missingmissingmissing
4323Apple-MacBook-Pro-M1FloatWithUnitsmistral-tiny--optimJuliaExpertAsk1SHOTtruetrue320231215_192640__68730.00.6529982[114, 65]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_192640__687.json100.00.9missing0.3
4324Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertCoTTask1SHOTtruefalse320231213_201601__20300.0001278664.495470[195, 222]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201601__203.json25.0missingmissingmissing
4325Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue320231225_190330__68930.0001564057.665062[195, 285]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190330__689.json100.0missingmissingmissing
4326Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse320231225_190332__84200.0001106521.813760[195, 184]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190332__842.json0.0missingmissingmissing
4327Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue320231227_193941__21439.2532e-56.21362[195, 144]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193941__214.json100.0missingmissingmissing
4328Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaExpertCoTTask1SHOTtruetrue320231227_193943__14430.0001242421.959532[195, 214]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_193943__144.json100.0missingmissingmissing
4329Apple-MacBook-Pro-M1FloatWithUnitsmistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue320231215_192639__15030.03.028282[195, 122]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_192639__150.json100.00.9missing0.3
4330Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapCoTTask1SHOTtruefalse320231213_201618__98900.0001578433.874930[380, 231]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201618__989.json25.0missingmissingmissing
4331Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapCoTTask1SHOTtruefalse320231225_190353__84000.0001718862.392970[380, 262]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190353__840.json25.0missingmissingmissing
4332Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue320231225_190356__73830.000193632.825332[380, 310]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190356__738.json100.0missingmissingmissing
4333Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue320231227_193957__38930.0002375713.740452[380, 407]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_193957__389.json100.0missingmissingmissing
4334Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapCoTTask1SHOTtruetrue320231227_194000__74830.0001623732.272122[380, 241]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194000__748.json100.0missingmissingmissing
4335Apple-MacBook-Pro-M1FloatWithUnitsmistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue320231215_192653__57130.03.665722[380, 404]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_192653__571.json100.00.9missing0.3
4336Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapTask1SHOTtruetrue320231213_201614__47030.0001670763.978222[378, 252]0.10.0-DEV21.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_201614__470.json100.0missingmissingmissing
4337Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapTask1SHOTtruefalse320231225_190347__32800.0002101113.054540[378, 347]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_190347__328.json25.0missingmissingmissing
4338Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapTask1SHOTtruetrue320231225_190351__24830.0002350263.596092[378, 402]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_190351__248.json100.0missingmissingmissing
4339Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapTask1SHOTtruefalse320231227_193950__53700.0002033163.132090[378, 332]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_193950__537.json25.0missingmissingmissing
4340Apple-MacBook-Pro-M1FloatWithUnitsmistral-tinyJuliaRecapTask1SHOTtruetrue320231227_193954__90830.000206943.265882[378, 340]0.10.0-DEV21.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_193954__908.json100.0missingmissingmissing
4341Apple-MacBook-Pro-M1FloatWithUnitsmistral-tiny--optimJuliaRecapTask1SHOTtruetrue320231215_192649__46530.02.811242[378, 312]0.10.0-DEV21.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_192649__465.json100.00.9missing0.3
4342Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse320231219_225023__39000.08.303350[1, 264]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_225023__390.json0.0missingmissingmissing
4343Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse320231225_024048__34100.04.493260[68, 105]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_024048__341.json0.0missing{\n "num_gpu": 99\n}missing
4344Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse320231225_024053__72400.04.636490[68, 109]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_024053__724.json0.0missing{\n "num_gpu": 99\n}missing
4345Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse320231225_164523__29500.02.742660[68, 59]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_164523__295.json0.0missing{\n "num_gpu": 99\n}missing
4346Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse320231225_164527__44600.03.416290[68, 77]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_164527__446.json0.0missing{\n "num_gpu": 99\n}missing
4347Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse320231225_024039__56800.03.194170[71, 71]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_024039__568.json0.0missing{\n "num_gpu": 99\n}missing
4348Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_024044__85300.04.870362[71, 115]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_024044__853.json75.0missing{\n "num_gpu": 99\n}missing
4349Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse320231225_164517__98500.02.540550[71, 54]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_164517__985.json25.0missing{\n "num_gpu": 99\n}missing
4350Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue320231225_164521__54900.03.754512[71, 86]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_164521__549.json75.0missing{\n "num_gpu": 99\n}missing
4351Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse320231226_231607__84500.03.882250[71, 89]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_231607__845.json25.0missing{\n "num_gpu": 99\n}missing
4352Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_024032__19800.02.536632[113, 49]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024032__198.json75.0missing{\n "num_gpu": 99\n}missing
4353Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse320231225_024035__90300.03.10980[113, 64]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024035__903.json25.0missing{\n "num_gpu": 99\n}missing
4354Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164512__43700.02.504482[113, 48]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164512__437.json75.0missing{\n "num_gpu": 99\n}missing
4355Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164514__76700.02.532642[113, 49]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164514__767.json75.0missing{\n "num_gpu": 99\n}missing
4356Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231226_231603__45400.02.956720[113, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231603__454.json0.0missing{\n "num_gpu": 99\n}missing
4357Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231225_024025__45800.010.21960[194, 86]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024025__458.json0.0missing{\n "num_gpu": 99\n}missing
4358Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_024030__22400.04.568920[194, 89]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024030__224.json25.0missing{\n "num_gpu": 99\n}missing
4359Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_164502__75900.011.09540[194, 115]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164502__759.json25.0missing{\n "num_gpu": 99\n}missing
4360Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164509__41600.07.218172[194, 158]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164509__416.json75.0missing{\n "num_gpu": 99\n}missing
4361Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231600__85000.013.74072[194, 188]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231600__850.json75.0missing{\n "num_gpu": 99\n}missing
4362Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_024136__40200.016.29470[380, 360]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024136__402.json25.0missing{\n "num_gpu": 99\n}missing
4363Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_024150__15500.013.95090[380, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024150__155.json25.0missing{\n "num_gpu": 99\n}missing
4364Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164549__89800.07.218152[380, 134]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164549__898.json75.0missing{\n "num_gpu": 99\n}missing
4365Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_164555__76400.06.321190[380, 111]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164555__764.json25.0missing{\n "num_gpu": 99\n}missing
4366Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231226_231635__42800.012.27220[380, 260]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231635__428.json0.0missing{\n "num_gpu": 99\n}missing
4367Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320231225_024108__77800.015.1880[378, 332]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024108__778.json0.0missing{\n "num_gpu": 99\n}missing
4368Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_024119__68600.011.32012[378, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024119__686.json75.0missing{\n "num_gpu": 99\n}missing
4369Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164535__65800.07.927942[378, 152]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164535__658.json75.0missing{\n "num_gpu": 99\n}missing
4370Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse320231225_164542__10400.06.997070[378, 128]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164542__104.json0.0missing{\n "num_gpu": 99\n}missing
4371Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse320231226_231623__13000.015.61730[378, 343]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231623__130.json25.0missing{\n "num_gpu": 99\n}missing
4372Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231104__98230.09.116962[70, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231104__982.json100.0missing{\n "num_gpu": 99\n}missing
4373Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231112__81530.07.563392[70, 236]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231112__815.json100.0missing{\n "num_gpu": 99\n}missing
4374Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231119__26930.06.903752[70, 213]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231119__269.json100.0missing{\n "num_gpu": 99\n}missing
4375Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231128__69230.09.01822[70, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231128__692.json100.0missing{\n "num_gpu": 99\n}missing
4376Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue320231227_231133__26330.05.381132[70, 165]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231133__263.json100.0missing{\n "num_gpu": 99\n}missing
4377Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231045__99300.03.047652[112, 82]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231045__993.json75.0missing{\n "num_gpu": 99\n}missing
4378Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231047__41730.02.543022[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231047__417.json100.0missing{\n "num_gpu": 99\n}missing
4379Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231050__92730.02.534812[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231050__927.json100.0missing{\n "num_gpu": 99\n}missing
4380Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231053__14530.02.556162[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231053__145.json100.0missing{\n "num_gpu": 99\n}missing
4381Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue320231227_231055__77730.02.527862[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231055__777.json100.0missing{\n "num_gpu": 99\n}missing
4382Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse320231227_231015__98700.05.657020[193, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231015__987.json25.0missing{\n "num_gpu": 99\n}missing
4383Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231021__28200.06.152332[193, 169]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231021__282.json75.0missing{\n "num_gpu": 99\n}missing
4384Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231029__31900.08.553972[193, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231029__319.json75.0missing{\n "num_gpu": 99\n}missing
4385Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231039__85800.09.323942[193, 271]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231039__858.json75.0missing{\n "num_gpu": 99\n}missing
4386Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue320231227_231042__71500.02.88112[193, 62]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231042__715.json75.0missing{\n "num_gpu": 99\n}missing
4387Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse320231227_231248__18600.011.00620[379, 294]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231248__186.json25.0missing{\n "num_gpu": 99\n}missing
4388Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue320231227_231258__28400.010.08412[379, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231258__284.json75.0missing{\n "num_gpu": 99\n}missing
4389Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue320231227_231311__97600.013.01212[379, 356]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231311__976.json75.0missing{\n "num_gpu": 99\n}missing
4390Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue320231227_231320__92400.08.144042[379, 205]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231320__924.json75.0missing{\n "num_gpu": 99\n}missing
4391Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse320231227_231330__93800.010.55170[379, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231330__938.json25.0missing{\n "num_gpu": 99\n}missing
4392Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue320231227_231145__35000.011.79382[377, 318]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231145__350.json75.0missing{\n "num_gpu": 99\n}missing
4393Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue320231227_231155__57300.010.15252[377, 268]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231155__573.json75.0missing{\n "num_gpu": 99\n}missing
4394Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue320231227_231213__65130.017.26892[377, 486]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231213__651.json100.0missing{\n "num_gpu": 99\n}missing
4395Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse320231227_231224__86700.011.66530[377, 314]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231224__867.json25.0missing{\n "num_gpu": 99\n}missing
4396Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse320231227_231237__82300.012.76930[377, 349]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231237__823.json25.0missing{\n "num_gpu": 99\n}missing
4397Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue320231227_231439__38730.012.66182[70, 316]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231439__387.json100.0missing{\n "num_gpu": 99\n}missing
4398Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231450__55800.010.32460[70, 256]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231450__558.json25.0missing{\n "num_gpu": 99\n}missing
4399Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue320231227_231458__59130.08.385272[70, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231458__591.json100.0missing{\n "num_gpu": 99\n}missing
4400Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue320231227_231505__16630.07.340282[70, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231505__166.json100.0missing{\n "num_gpu": 99\n}missing
4401Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse320231227_231518__39500.012.07910[70, 301]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_231518__395.json25.0missing{\n "num_gpu": 99\n}missing
4402Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231414__29730.03.163882[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231414__297.json100.0missing{\n "num_gpu": 99\n}missing
4403Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231417__97130.03.155852[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231417__971.json100.0missing{\n "num_gpu": 99\n}missing
4404Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231420__72130.03.167752[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231420__721.json100.0missing{\n "num_gpu": 99\n}missing
4405Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231423__30730.03.155992[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231423__307.json100.0missing{\n "num_gpu": 99\n}missing
4406Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_231427__15030.03.168342[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_231427__150.json100.0missing{\n "num_gpu": 99\n}missing
4407Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231227_231336__26100.05.868240[193, 101]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231336__261.json25.0missing{\n "num_gpu": 99\n}missing
4408Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231341__35630.05.044882[193, 101]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231341__356.json100.0missing{\n "num_gpu": 99\n}missing
4409Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231352__84930.010.95192[193, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231352__849.json100.0missing{\n "num_gpu": 99\n}missing
4410Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231407__23430.015.14532[193, 358]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231407__234.json100.0missing{\n "num_gpu": 99\n}missing
4411Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_231411__51300.03.386262[193, 58]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231411__513.json75.0missing{\n "num_gpu": 99\n}missing
4412Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_231648__29800.09.389322[379, 187]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231648__298.json75.0missing{\n "num_gpu": 99\n}missing
4413Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_231659__56500.010.79490[379, 222]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231659__565.json25.0missing{\n "num_gpu": 99\n}missing
4414Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_231712__98800.013.17822[379, 281]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231712__988.json75.0missing{\n "num_gpu": 99\n}missing
4415Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_231725__87300.012.68660[379, 269]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231725__873.json25.0missing{\n "num_gpu": 99\n}missing
4416Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231227_231737__62600.012.81110[379, 272]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_231737__626.json25.0missing{\n "num_gpu": 99\n}missing
4417Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231532__26400.014.4650[377, 313]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231532__264.json25.0missing{\n "num_gpu": 99\n}missing
4418Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_231545__43100.013.4152[377, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231545__431.json75.0missing{\n "num_gpu": 99\n}missing
4419Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231605__81900.019.55520[377, 437]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231605__819.json25.0missing{\n "num_gpu": 99\n}missing
4420Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_231624__51730.018.79952[377, 419]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231624__517.json100.0missing{\n "num_gpu": 99\n}missing
4421Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse320231227_231638__21200.014.63010[377, 317]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_231638__212.json25.0missing{\n "num_gpu": 99\n}missing
4422Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse320231226_121028__74500.011.02480[67, 197]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_121028__745.json0.0missing{\n "num_gpu": 99\n}missing
4423Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse320231226_121045__48900.016.21810[67, 290]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_121045__489.json0.0missing{\n "num_gpu": 99\n}missing
4424Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse320231226_121005__63300.014.23110[70, 256]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121005__633.json25.0missing{\n "num_gpu": 99\n}missing
4425Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue320231226_121017__84330.011.94232[70, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121017__843.json100.0missing{\n "num_gpu": 99\n}missing
4426Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue320231226_231924__95130.019.54352[70, 359]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_231924__951.json100.0missing{\n "num_gpu": 99\n}missing
4427Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue320231226_120947__27730.04.289542[112, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120947__277.json100.0missing{\n "num_gpu": 99\n}missing
4428Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue320231226_120951__99030.04.243732[112, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_120951__990.json100.0missing{\n "num_gpu": 99\n}missing
4429Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue320231226_231904__16430.04.185622[112, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_231904__164.json100.0missing{\n "num_gpu": 99\n}missing
4430Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue320231226_120936__53430.04.337172[193, 57]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120936__534.json100.0missing{\n "num_gpu": 99\n}missing
4431Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue320231226_120942__95930.06.515272[193, 97]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_120942__959.json100.0missing{\n "num_gpu": 99\n}missing
4432Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue320231226_231900__84430.021.74172[193, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231900__844.json100.0missing{\n "num_gpu": 99\n}missing
4433Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse320231226_121137__42100.015.85340[379, 248]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121137__421.json25.0missing{\n "num_gpu": 99\n}missing
4434Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse320231226_121156__39500.019.51190[379, 312]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121156__395.json25.0missing{\n "num_gpu": 99\n}missing
4435Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue320231226_232000__94700.015.71922[379, 252]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232000__947.json75.0missing{\n "num_gpu": 99\n}missing
4436Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue320231226_121102__19500.017.74232[377, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121102__195.json75.0missing{\n "num_gpu": 99\n}missing
4437Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue320231226_121120__47000.017.99312[377, 285]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121120__470.json75.0missing{\n "num_gpu": 99\n}missing
4438Apple-MacBook-Pro-M1FloatWithUnitsmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue320231226_231944__27730.019.94422[377, 329]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_231944__277.json100.0missing{\n "num_gpu": 99\n}missing
4439Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue320231227_110712__57430.044.56992[78, 261]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_110712__574.json100.0missing{\n "num_gpu": 99\n}missing
4440Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue320231227_110744__17230.031.8212[78, 183]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_110744__172.json100.0missing{\n "num_gpu": 99\n}missing
4441Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue320231227_110829__96630.044.89162[78, 263]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_110829__966.json100.0missing{\n "num_gpu": 99\n}missing
4442Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse320231227_144830__69200.053.98220[78, 317]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_144830__692.json25.0missing{\n "num_gpu": 99\n}missing
4443Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue320231227_144902__36030.031.28322[78, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_144902__360.json100.0missing{\n "num_gpu": 99\n}missing
4444Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_110601__70030.013.8572[117, 67]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_110601__700.json100.0missing{\n "num_gpu": 99\n}missing
4445Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_110615__44930.013.70582[117, 66]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_110615__449.json100.0missing{\n "num_gpu": 99\n}missing
4446Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231227_110627__47200.012.41080[117, 58]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_110627__472.json0.0missing{\n "num_gpu": 99\n}missing
4447Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_144721__98430.020.43952[117, 107]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_144721__984.json100.0missing{\n "num_gpu": 99\n}missing
4448Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue320231227_144736__22730.014.74582[117, 72]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_144736__227.json100.0missing{\n "num_gpu": 99\n}missing
4449Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_110434__99830.058.6052[197, 294]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110434__998.json100.0missing{\n "num_gpu": 99\n}missing
4450Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_110507__54130.033.2062[197, 171]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110507__541.json100.0missing{\n "num_gpu": 99\n}missing
4451Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231227_110547__98200.040.30860[197, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_110547__982.json0.0missing{\n "num_gpu": 99\n}missing
4452Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_144552__78130.035.67672[197, 185]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_144552__781.json100.0missing{\n "num_gpu": 99\n}missing
4453Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231227_144701__96930.069.10442[197, 385]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_144701__969.json100.0missing{\n "num_gpu": 99\n}missing
4454Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_111137__17500.055.09542[391, 268]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111137__175.json75.0missing{\n "num_gpu": 99\n}missing
4455Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_111214__13830.036.70472[391, 159]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111214__138.json100.0missing{\n "num_gpu": 99\n}missing
4456Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_111302__44530.048.66152[391, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111302__445.json100.0missing{\n "num_gpu": 99\n}missing
4457Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_145152__11530.061.17572[391, 302]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145152__115.json100.0missing{\n "num_gpu": 99\n}missing
4458Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231227_145237__81130.044.32372[391, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145237__811.json100.0missing{\n "num_gpu": 99\n}missing
4459Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_110900__60830.031.17232[389, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_110900__608.json100.0missing{\n "num_gpu": 99\n}missing
4460Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_110943__91130.043.41572[389, 199]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_110943__911.json100.0missing{\n "num_gpu": 99\n}missing
4461Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_111042__42000.058.29720[389, 287]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_111042__420.json50.0missing{\n "num_gpu": 99\n}missing
4462Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse320231227_144946__13600.044.82230[389, 206]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_144946__136.json0.0missing{\n "num_gpu": 99\n}missing
4463Apple-MacBook-Pro-M1FloatWithUnitsnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue320231227_145051__59230.064.38332[389, 321]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_145051__592.json100.0missing{\n "num_gpu": 99\n}missing
4464Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse320231219_225350__44700.06.793560[1, 218]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_225350__447.json0.0missingmissingmissing
4465Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse320231225_024250__22400.011.00480[76, 274]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_024250__224.json0.0missing{\n "num_gpu": 99\n}missing
4466Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse320231225_024255__38100.04.834790[76, 114]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_024255__381.json0.0missing{\n "num_gpu": 99\n}missing
4467Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse320231225_164657__16000.011.39210[76, 285]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_164657__160.json0.0missing{\n "num_gpu": 99\n}missing
4468Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse320231225_164703__42400.06.310420[76, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_164703__424.json0.0missing{\n "num_gpu": 99\n}missing
4469Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_024232__88800.08.327032[79, 205]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_024232__888.json75.0missing{\n "num_gpu": 99\n}missing
4470Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_024239__64930.06.71522[79, 163]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_024239__649.json100.0missing{\n "num_gpu": 99\n}missing
4471Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_164638__30500.07.076382[79, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_164638__305.json75.0missing{\n "num_gpu": 99\n}missing
4472Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue320231225_164646__25000.07.661052[79, 188]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_164646__250.json75.0missing{\n "num_gpu": 99\n}missing
4473Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse320231226_231707__19200.06.839550[79, 166]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_231707__192.json25.0missing{\n "num_gpu": 99\n}missing
4474Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_024220__52300.03.504932[121, 74]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024220__523.json75.0missing{\n "num_gpu": 99\n}missing
4475Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_024224__44400.03.507412[121, 74]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_024224__444.json75.0missing{\n "num_gpu": 99\n}missing
4476Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164628__52430.03.159922[121, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164628__524.json100.0missing{\n "num_gpu": 99\n}missing
4477Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164631__17430.03.153532[121, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164631__174.json100.0missing{\n "num_gpu": 99\n}missing
4478Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue320231226_231700__23830.06.552952[121, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231700__238.json100.0missing{\n "num_gpu": 99\n}missing
4479Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_024208__99600.018.48750[202, 283]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024208__996.json25.0missing{\n "num_gpu": 99\n}missing
4480Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231225_024217__29300.08.540660[202, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024217__293.json0.0missing{\n "num_gpu": 99\n}missing
4481Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164613__72230.017.88292[202, 264]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164613__722.json100.0missing{\n "num_gpu": 99\n}missing
4482Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164624__87800.010.772[202, 249]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164624__878.json75.0missing{\n "num_gpu": 99\n}missing
4483Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231653__74630.017.93492[202, 279]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231653__746.json100.0missing{\n "num_gpu": 99\n}missing
4484Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_024336__58200.012.50922[388, 262]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024336__582.json75.0missing{\n "num_gpu": 99\n}missing
4485Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_024348__64600.012.24422[388, 255]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024348__646.json75.0missing{\n "num_gpu": 99\n}missing
4486Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164736__81130.010.39242[388, 210]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164736__811.json100.0missing{\n "num_gpu": 99\n}missing
4487Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse320231225_164748__27800.011.56150[388, 239]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164748__278.json25.0missing{\n "num_gpu": 99\n}missing
4488Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231226_231730__43430.011.87482[388, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231730__434.json100.0missing{\n "num_gpu": 99\n}missing
4489Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_024305__25800.09.878682[386, 196]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024305__258.json75.0missing{\n "num_gpu": 99\n}missing
4490Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_024323__96800.018.39922[386, 407]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_024323__968.json75.0missing{\n "num_gpu": 99\n}missing
4491Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164715__23200.011.56932[386, 239]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164715__232.json75.0missing{\n "num_gpu": 99\n}missing
4492Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164726__88630.010.45772[386, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164726__886.json100.0missing{\n "num_gpu": 99\n}missing
4493Apple-MacBook-Pro-M1FloatWithUnitsopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue320231226_231718__28200.011.67932[386, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231718__282.json75.0missing{\n "num_gpu": 99\n}missing
4494Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralAsIs1SHOTfalsefalse320231214_001555__17800.07.990510[59, 242]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_001555__178.json0.0missingmissingmissing
4495Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralAsIs1SHOTfalsefalse320231225_020213__10900.05.842410[75, 182]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_020213__109.json0.0missing{\n "num_gpu": 99\n}missing
4496Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralAsIs1SHOTfalsefalse320231225_020225__72000.011.21040[75, 360]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_020225__720.json0.0missing{\n "num_gpu": 99\n}missing
4497Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralAsIs1SHOTfalsefalse320231225_160753__68300.07.347980[75, 235]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_160753__683.json0.0missing{\n "num_gpu": 99\n}missing
4498Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralAsIs1SHOTfalsefalse320231225_160800__20200.06.337860[75, 200]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_160800__202.json0.0missing{\n "num_gpu": 99\n}missing
4499Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruefalse320231225_020201__96900.011.85590[77, 379]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_020201__969.json25.0missing{\n "num_gpu": 99\n}missing
4500Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231225_020208__24400.06.092862[77, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_020208__244.json75.0missing{\n "num_gpu": 99\n}missing
4501Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231225_160738__78800.010.42230[77, 337]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_160738__788.json50.0missing{\n "num_gpu": 99\n}missing
4502Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231225_160746__61100.07.587972[77, 242]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_160746__611.json75.0missing{\n "num_gpu": 99\n}missing
4503Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralInJulia1SHOTtruetrue320231226_225903__19700.09.450562[77, 303]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_225903__197.json75.0missing{\n "num_gpu": 99\n}missing
4504Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse320231225_020140__96200.09.109630[119, 284]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_020140__962.json0.0missing{\n "num_gpu": 99\n}missing
4505Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue320231225_020149__73530.09.800192[119, 307]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_020149__735.json100.0missing{\n "num_gpu": 99\n}missing
4506Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue320231225_160721__52430.010.29452[119, 326]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_160721__524.json100.0missing{\n "num_gpu": 99\n}missing
4507Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse320231225_160728__81000.06.596480[119, 203]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_160728__810.json0.0missing{\n "num_gpu": 99\n}missing
4508Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue320231226_225854__26400.03.633722[119, 103]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_225854__264.json75.0missing{\n "num_gpu": 99\n}missing
4509Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231225_020115__95630.014.21582[200, 259]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020115__956.json100.0missing{\n "num_gpu": 99\n}missing
4510Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231225_020130__66230.014.94132[200, 454]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020130__662.json100.0missing{\n "num_gpu": 99\n}missing
4511Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231225_160700__63530.015.79632[200, 319]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160700__635.json100.0missing{\n "num_gpu": 99\n}missing
4512Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse320231225_160711__52100.010.42820[200, 313]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160711__521.json0.0missing{\n "num_gpu": 99\n}missing
4513Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue320231226_225850__25530.012.48742[200, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225850__255.json100.0missing{\n "num_gpu": 99\n}missing
4514Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231225_020245__42500.02.492090[386, 21]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020245__425.json0.0missing{\n "num_gpu": 99\n}missing
4515Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231225_020247__47000.02.368470[386, 17]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020247__470.json0.0missing{\n "num_gpu": 99\n}missing
4516Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue320231225_160834__63030.011.37832[386, 307]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160834__630.json100.0missing{\n "num_gpu": 99\n}missing
4517Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231225_160836__77000.02.648020[386, 26]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160836__770.json0.0missing{\n "num_gpu": 99\n}missing
4518Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse320231226_225916__98800.04.104950[386, 74]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225916__988.json0.0missing{\n "num_gpu": 99\n}missing
4519Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_020235__90500.010.42272[384, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_020235__905.json75.0missing{\n "num_gpu": 99\n}missing
4520Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_020242__90900.07.026352[384, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_020242__909.json75.0missing{\n "num_gpu": 99\n}missing
4521Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_160811__85200.010.95442[384, 300]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_160811__852.json75.0missing{\n "num_gpu": 99\n}missing
4522Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231225_160822__85130.011.52972[384, 318]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_160822__851.json100.0missing{\n "num_gpu": 99\n}missing
4523Apple-MacBook-Pro-M1FloatWithUnitsopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue320231226_225912__64500.08.714862[384, 227]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_225912__645.json75.0missing{\n "num_gpu": 99\n}missing
4524Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bAsIs1SHOTfalsefalse320231214_002429__56700.08.034340[59, 243]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__AsIs__1SHOT__20231214_002429__567.json0.0missingmissingmissing
4525Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bAsIs1SHOTfalsefalse320231225_022147__76100.06.597150[76, 111]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__AsIs__1SHOT__20231225_022147__761.json0.0missing{\n "num_gpu": 99\n}missing
4526Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bAsIs1SHOTfalsefalse320231225_022155__28400.08.167820[76, 141]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__AsIs__1SHOT__20231225_022155__284.json0.0missing{\n "num_gpu": 99\n}missing
4527Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bAsIs1SHOTfalsefalse320231225_162542__87000.08.380320[76, 146]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__AsIs__1SHOT__20231225_162542__870.json0.0missing{\n "num_gpu": 99\n}missing
4528Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bAsIs1SHOTfalsefalse320231225_162552__37100.09.770450[76, 173]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__AsIs__1SHOT__20231225_162552__371.json0.0missing{\n "num_gpu": 99\n}missing
4529Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruetrue320231225_022130__26530.07.390472[78, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_022130__265.json100.0missing{\n "num_gpu": 99\n}missing
4530Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruetrue320231225_022140__45330.010.05712[78, 177]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_022140__453.json100.0missing{\n "num_gpu": 99\n}missing
4531Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruetrue320231225_162524__94800.05.519372[78, 91]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_162524__948.json75.0missing{\n "num_gpu": 99\n}missing
4532Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruetrue320231225_162534__51030.09.381362[78, 165]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231225_162534__510.json100.0missing{\n "num_gpu": 99\n}missing
4533Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bInJulia1SHOTtruefalse320231226_230705__47600.012.79670[78, 229]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__InJulia__1SHOT__20231226_230705__476.json25.0missing{\n "num_gpu": 99\n}missing
4534Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_022118__75500.04.166540[118, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_022118__755.json0.0missing{\n "num_gpu": 99\n}missing
4535Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_022122__83900.04.176640[118, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_022122__839.json0.0missing{\n "num_gpu": 99\n}missing
4536Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_162515__37800.03.94970[118, 56]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_162515__378.json0.0missing{\n "num_gpu": 99\n}missing
4537Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231225_162519__62600.04.148890[118, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_162519__626.json0.0missing{\n "num_gpu": 99\n}missing
4538Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertAsk1SHOTfalsefalse320231226_230652__96400.04.163540[118, 60]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_230652__964.json0.0missing{\n "num_gpu": 99\n}missing
4539Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTtruetrue320231225_022109__50830.030.23812[200, 349]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022109__508.json100.0missing{\n "num_gpu": 99\n}missing
4540Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse320231225_022114__11400.05.186130[200, 64]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022114__114.json0.0missing{\n "num_gpu": 99\n}missing
4541Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTtruetrue320231225_162504__28200.020.53892[200, 178]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162504__282.json75.0missing{\n "num_gpu": 99\n}missing
4542Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse320231225_162511__76800.06.295660[200, 86]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162511__768.json0.0missing{\n "num_gpu": 99\n}missing
4543Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaExpertCoTTask1SHOTfalsefalse320231226_230648__34600.015.69080[200, 94]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230648__346.json0.0missing{\n "num_gpu": 99\n}missing
4544Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_022251__56700.025.38480[382, 400]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022251__567.json0.0missing{\n "num_gpu": 99\n}missing
4545Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_022311__41400.019.69310[382, 300]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022311__414.json0.0missing{\n "num_gpu": 99\n}missing
4546Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_162631__15100.06.744750[382, 68]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162631__151.json0.0missing{\n "num_gpu": 99\n}missing
4547Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231225_162717__24800.045.89840[382, 751]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162717__248.json0.0missing{\n "num_gpu": 99\n}missing
4548Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapCoTTask1SHOTfalsefalse320231226_230748__72600.028.78040[382, 460]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230748__726.json0.0missing{\n "num_gpu": 99\n}missing
4549Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTfalsefalse320231225_022210__24700.014.82250[379, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_022210__247.json0.0missing{\n "num_gpu": 99\n}missing
4550Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTtruetrue320231225_022226__52330.016.26492[379, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_022226__523.json100.0missing{\n "num_gpu": 99\n}missing
4551Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTtruefalse320231225_162606__88700.013.70230[379, 195]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_162606__887.json25.0missing{\n "num_gpu": 99\n}missing
4552Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTtruetrue320231225_162624__59300.018.29222[379, 278]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_162624__593.json75.0missing{\n "num_gpu": 99\n}missing
4553Apple-MacBook-Pro-M1FloatWithUnitsorca2:13bJuliaRecapTask1SHOTfalsefalse320231226_230719__90600.014.21390[379, 204]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_230719__906.json0.0missing{\n "num_gpu": 99\n}missing
4554Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse320231219_225644__35500.05.937990[1, 191]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_225644__355.json0.0missingmissingmissing
4555Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse320231225_024452__84400.06.252990[67, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_024452__844.json0.0missing{\n "num_gpu": 99\n}missing
4556Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse320231225_024509__59000.016.75050[67, 637]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_024509__590.json0.0missing{\n "num_gpu": 99\n}missing
4557Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse320231225_164910__20300.019.67840[67, 743]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_164910__203.json0.0missing{\n "num_gpu": 99\n}missing
4558Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse320231225_164935__41900.025.30390[67, 939]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_164935__419.json0.0missing{\n "num_gpu": 99\n}missing
4559Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_024422__58400.02.147330[70, 77]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_024422__584.json0.0missing{\n "num_gpu": 99\n}missing
4560Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_024446__71200.024.1440[70, 895]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_024446__712.json0.0missing{\n "num_gpu": 99\n}missing
4561Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_164834__84200.01.918420[70, 68]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_164834__842.json0.0missing{\n "num_gpu": 99\n}missing
4562Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231225_164850__58900.016.05430[70, 612]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_164850__589.json0.0missing{\n "num_gpu": 99\n}missing
4563Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse320231226_231758__70100.01.776320[70, 62]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_231758__701.json0.0missing{\n "num_gpu": 99\n}missing
4564Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_024419__79300.022.89010[107, 843]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_024419__793.json0.0missing{\n "num_gpu": 99\n}missing
4565Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_024420__33000.00.4325990[107, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_024420__330.json0.0missing{\n "num_gpu": 99\n}missing
4566Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_164815__67500.019.90990[107, 741]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_164815__675.json0.0missing{\n "num_gpu": 99\n}missing
4567Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231225_164832__84000.017.1680[107, 645]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_164832__840.json0.0missing{\n "num_gpu": 99\n}missing
4568Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse320231226_231756__17200.020.56820[107, 761]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_231756__172.json0.0missing{\n "num_gpu": 99\n}missing
4569Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_024354__53000.05.96110[187, 69]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024354__530.json0.0missing{\n "num_gpu": 99\n}missing
4570Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_024356__87800.02.176680[187, 65]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024356__878.json0.0missing{\n "num_gpu": 99\n}missing
4571Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_164753__17000.04.775240[187, 22]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164753__170.json0.0missing{\n "num_gpu": 99\n}missing
4572Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231225_164755__65300.02.500780[187, 78]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164755__653.json0.0missing{\n "num_gpu": 99\n}missing
4573Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse320231226_231736__38300.05.386560[187, 55]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231736__383.json0.0missing{\n "num_gpu": 99\n}missing
4574Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_024526__54800.07.351150[359, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024526__548.json0.0missing{\n "num_gpu": 99\n}missing
4575Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_024528__53500.01.302830[359, 4]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024528__535.json0.0missing{\n "num_gpu": 99\n}missing
4576Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_164953__84700.01.331730[359, 5]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164953__847.json0.0missing{\n "num_gpu": 99\n}missing
4577Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231225_164956__53900.02.656850[359, 57]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164956__539.json0.0missing{\n "num_gpu": 99\n}missing
4578Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse320231226_231838__64900.09.525330[359, 312]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231838__649.json0.0missing{\n "num_gpu": 99\n}missing
4579Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_024515__74700.05.330470[356, 158]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_024515__747.json0.0missing{\n "num_gpu": 99\n}missing
4580Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_024519__78700.04.257170[356, 118]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_024519__787.json0.0missing{\n "num_gpu": 99\n}missing
4581Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_164936__68900.01.225830[356, 1]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_164936__689.json0.0missing{\n "num_gpu": 99\n}missing
4582Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231225_164952__40800.015.60230[356, 530]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_164952__408.json0.0missing{\n "num_gpu": 99\n}missing
4583Apple-MacBook-Pro-M1FloatWithUnitsphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse320231226_231829__15700.030.81990[356, 1028]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_231829__157.json0.0missing{\n "num_gpu": 99\n}missing
4584Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2AsIs1SHOTfalsefalse320231214_002539__55100.07.889520[59, 239]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_002539__551.json0.0missingmissingmissing
4585Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2AsIs1SHOTfalsefalse320231225_022629__25600.025.17750[84, 189]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_022629__256.json0.0missing{\n "num_gpu": 99\n}missing
4586Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2AsIs1SHOTtruetrue320231225_022648__28930.019.46472[84, 143]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_022648__289.json100.0missing{\n "num_gpu": 99\n}missing
4587Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2AsIs1SHOTtruetrue320231225_163104__54330.017.53132[84, 128]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_163104__543.json100.0missing{\n "num_gpu": 99\n}missing
4588Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2AsIs1SHOTfalsefalse320231225_163132__29400.027.73950[84, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_163132__294.json0.0missing{\n "num_gpu": 99\n}missing
4589Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_022542__39630.034.43572[86, 264]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_022542__396.json100.0missing{\n "num_gpu": 99\n}missing
4590Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_022603__90230.021.23432[86, 157]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_022603__902.json100.0missing{\n "num_gpu": 99\n}missing
4591Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_163015__45830.035.95512[86, 278]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_163015__458.json100.0missing{\n "num_gpu": 99\n}missing
4592Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231225_163047__57730.031.06512[86, 238]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_163047__577.json100.0missing{\n "num_gpu": 99\n}missing
4593Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2InJulia1SHOTtruetrue320231226_230952__44430.031.71182[86, 241]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_230952__444.json100.0missing{\n "num_gpu": 99\n}missing
4594Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_022441__24030.029.04992[126, 215]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_022441__240.json100.0missing{\n "num_gpu": 99\n}missing
4595Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_022508__84830.026.91982[126, 198]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_022508__848.json100.0missing{\n "num_gpu": 99\n}missing
4596Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_162919__48230.029.37782[126, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_162919__482.json100.0missing{\n "num_gpu": 99\n}missing
4597Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231225_162939__48930.020.61282[126, 148]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_162939__489.json100.0missing{\n "num_gpu": 99\n}missing
4598Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue320231226_230921__25030.026.06442[126, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_230921__250.json100.0missing{\n "num_gpu": 99\n}missing
4599Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_022354__93930.043.30922[208, 131]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022354__939.json100.0missing{\n "num_gpu": 99\n}missing
4600Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_022411__90430.017.04552[208, 102]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_022411__904.json100.0missing{\n "num_gpu": 99\n}missing
4601Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_162819__15030.062.2642[208, 291]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162819__150.json100.0missing{\n "num_gpu": 99\n}missing
4602Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231225_162849__21730.030.24352[208, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162849__217.json100.0missing{\n "num_gpu": 99\n}missing
4603Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue320231226_230854__29630.066.85532[208, 333]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230854__296.json100.0missing{\n "num_gpu": 99\n}missing
4604Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_022854__55530.054.91232[390, 365]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022854__555.json100.0missing{\n "num_gpu": 99\n}missing
4605Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_022919__44630.024.97242[390, 132]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022919__446.json100.0missing{\n "num_gpu": 99\n}missing
4606Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_163311__64630.021.05632[390, 102]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_163311__646.json100.0missing{\n "num_gpu": 99\n}missing
4607Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231225_163342__91330.030.43322[390, 176]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_163342__913.json100.0missing{\n "num_gpu": 99\n}missing
4608Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue320231226_231055__31030.020.94442[390, 101]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231055__310.json100.0missing{\n "num_gpu": 99\n}missing
4609Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue320231225_022724__79630.035.38622[387, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_022724__796.json100.0missing{\n "num_gpu": 99\n}missing
4610Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue320231225_022759__42030.035.76492[387, 217]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_022759__420.json100.0missing{\n "num_gpu": 99\n}missing
4611Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse320231225_163203__37300.031.20060[387, 181]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_163203__373.json25.0missing{\n "num_gpu": 99\n}missing
4612Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue320231225_163250__19730.046.92672[387, 305]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_163250__197.json100.0missing{\n "num_gpu": 99\n}missing
4613Apple-MacBook-Pro-M1FloatWithUnitsphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue320231226_231034__65930.041.20172[387, 260]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_231034__659.json100.0missing{\n "num_gpu": 99\n}missing
4614Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse320231219_224654__57700.08.336850[1, 265]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_224654__577.json0.0missingmissingmissing
4615Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse320231225_023906__40600.07.349220[77, 117]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_023906__406.json0.0missing{\n "num_gpu": 99\n}missing
4616Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse320231225_023916__31000.010.10620[77, 166]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_023916__310.json0.0missing{\n "num_gpu": 99\n}missing
4617Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse320231225_164319__43200.013.80130[77, 231]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_164319__432.json0.0missing{\n "num_gpu": 99\n}missing
4618Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse320231225_164336__22700.016.93660[77, 286]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_164336__227.json0.0missing{\n "num_gpu": 99\n}missing
4619Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue320231225_023840__68500.09.309662[79, 152]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_023840__685.json75.0missing{\n "num_gpu": 99\n}missing
4620Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue320231225_023858__81600.017.74142[79, 299]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_023858__816.json75.0missing{\n "num_gpu": 99\n}missing
4621Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue320231225_164249__12100.09.877582[79, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_164249__121.json75.0missing{\n "num_gpu": 99\n}missing
4622Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue320231225_164305__73600.015.74252[79, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_164305__736.json75.0missing{\n "num_gpu": 99\n}missing
4623Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse320231226_231518__29200.010.73840[79, 177]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_231518__292.json0.0missing{\n "num_gpu": 99\n}missing
4624Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231225_023823__38100.010.63940[121, 170]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023823__381.json0.0missing{\n "num_gpu": 99\n}missing
4625Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231225_023831__27700.08.480930[121, 132]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_023831__277.json0.0missing{\n "num_gpu": 99\n}missing
4626Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164230__79630.014.96362[121, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164230__796.json100.0missing{\n "num_gpu": 99\n}missing
4627Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue320231225_164239__50000.09.394632[121, 148]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_164239__500.json75.0missing{\n "num_gpu": 99\n}missing
4628Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse320231226_231507__97000.04.840490[121, 68]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_231507__970.json0.0missing{\n "num_gpu": 99\n}missing
4629Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_023757__76830.022.35642[202, 195]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023757__768.json100.0missing{\n "num_gpu": 99\n}missing
4630Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse320231225_023812__31300.014.62490[202, 225]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_023812__313.json25.0missing{\n "num_gpu": 99\n}missing
4631Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse320231225_164200__59500.024.47620[202, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164200__595.json0.0missing{\n "num_gpu": 99\n}missing
4632Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231225_164215__14500.014.94032[202, 230]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_164215__145.json75.0missing{\n "num_gpu": 99\n}missing
4633Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue320231226_231502__69030.023.26292[202, 226]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_231502__690.json100.0missing{\n "num_gpu": 99\n}missing
4634Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231225_024001__71300.015.00780[388, 202]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024001__713.json0.0missing{\n "num_gpu": 99\n}missing
4635Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231225_024015__61200.013.99520[388, 185]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024015__612.json0.0missing{\n "num_gpu": 99\n}missing
4636Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue320231225_164434__88600.022.11332[388, 322]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164434__886.json75.0missing{\n "num_gpu": 99\n}missing
4637Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231225_164451__21300.016.20740[388, 223]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_164451__213.json0.0missing{\n "num_gpu": 99\n}missing
4638Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse320231226_231546__48600.014.11040[388, 187]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_231546__486.json0.0missing{\n "num_gpu": 99\n}missing
4639Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse320231225_023930__52400.013.76030[386, 181]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023930__524.json0.0missing{\n "num_gpu": 99\n}missing
4640Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_023946__74830.016.24222[386, 223]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_023946__748.json100.0missing{\n "num_gpu": 99\n}missing
4641Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164352__90500.015.93372[386, 218]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164352__905.json75.0missing{\n "num_gpu": 99\n}missing
4642Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue320231225_164412__34300.020.48312[386, 295]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_164412__343.json75.0missing{\n "num_gpu": 99\n}missing
4643Apple-MacBook-Pro-M1FloatWithUnitssolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue320231226_231532__22000.014.39492[386, 192]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_231532__220.json75.0missing{\n "num_gpu": 99\n}missing
4644Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrAsIs1SHOTfalsefalse320231214_002315__47500.010.43510[59, 316]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_002315__475.json0.0missingmissingmissing
4645Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrAsIs1SHOTfalsefalse320231225_022009__17900.03.043340[78, 171]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_022009__179.json0.0missing{\n "num_gpu": 99\n}missing
4646Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrAsIs1SHOTfalsefalse320231225_022011__27300.02.125440[78, 116]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_022011__273.json0.0missing{\n "num_gpu": 99\n}missing
4647Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrAsIs1SHOTfalsefalse320231225_162415__34800.03.170620[78, 179]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_162415__348.json0.0missing{\n "num_gpu": 99\n}missing
4648Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrAsIs1SHOTfalsefalse320231225_162419__73400.03.368240[78, 191]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_162419__734.json0.0missing{\n "num_gpu": 99\n}missing
4649Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTfalsefalse320231225_022003__93300.06.596640[81, 372]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_022003__933.json0.0missing{\n "num_gpu": 99\n}missing
4650Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTfalsefalse320231225_022006__20300.02.692170[81, 150]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_022006__203.json0.0missing{\n "num_gpu": 99\n}missing
4651Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTfalsefalse320231225_162409__91400.06.222030[81, 354]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_162409__914.json0.0missing{\n "num_gpu": 99\n}missing
4652Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTfalsefalse320231225_162412__57800.03.413420[81, 193]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_162412__578.json0.0missing{\n "num_gpu": 99\n}missing
4653Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrInJulia1SHOTfalsefalse320231226_230620__80700.06.315140[81, 357]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_230620__807.json0.0missing{\n "num_gpu": 99\n}missing
4654Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_021956__32400.01.563280[118, 77]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_021956__324.json0.0missing{\n "num_gpu": 99\n}missing
4655Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_021957__93600.01.152110[118, 51]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_021957__936.json0.0missing{\n "num_gpu": 99\n}missing
4656Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_162400__93900.01.289420[118, 61]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_162400__939.json0.0missing{\n "num_gpu": 99\n}missing
4657Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231225_162403__41400.02.940060[118, 159]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_162403__414.json0.0missing{\n "num_gpu": 99\n}missing
4658Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse320231226_230614__22700.02.541520[118, 135]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_230614__227.json0.0missing{\n "num_gpu": 99\n}missing
4659Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_021949__95700.06.36830[196, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021949__957.json0.0missing{\n "num_gpu": 99\n}missing
4660Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_021954__33900.04.784610[196, 244]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_021954__339.json0.0missing{\n "num_gpu": 99\n}missing
4661Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_162352__23000.07.150430[196, 232]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162352__230.json0.0missing{\n "num_gpu": 99\n}missing
4662Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231225_162358__45500.06.72910[196, 353]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_162358__455.json0.0missing{\n "num_gpu": 99\n}missing
4663Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse320231226_230611__18700.06.873980[196, 209]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230611__187.json0.0missing{\n "num_gpu": 99\n}missing
4664Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231225_022034__60900.08.897580[368, 416]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022034__609.json0.0missing{\n "num_gpu": 99\n}missing
4665Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231225_022039__48500.04.966160[368, 213]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_022039__485.json0.0missing{\n "num_gpu": 99\n}missing
4666Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231225_162438__69400.07.300460[368, 336]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162438__694.json0.0missing{\n "num_gpu": 99\n}missing
4667Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231225_162444__45500.05.04310[368, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_162444__455.json0.0missing{\n "num_gpu": 99\n}missing
4668Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse320231226_230632__10200.05.938170[368, 265]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230632__102.json0.0missing{\n "num_gpu": 99\n}missing
4669Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse320231225_022019__55900.08.048990[366, 373]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_022019__559.json0.0missing{\n "num_gpu": 99\n}missing
4670Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse320231225_022025__99200.05.233320[366, 228]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_022025__992.json0.0missing{\n "num_gpu": 99\n}missing
4671Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse320231225_162426__81900.07.03320[366, 324]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_162426__819.json0.0missing{\n "num_gpu": 99\n}missing
4672Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse320231225_162431__51200.05.421250[366, 240]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_162431__512.json0.0missing{\n "num_gpu": 99\n}missing
4673Apple-MacBook-Pro-M1FloatWithUnitsstablelm-zephyrJuliaRecapTask1SHOTfalsefalse320231226_230626__37500.05.893450[366, 263]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_230626__375.json0.0missing{\n "num_gpu": 99\n}missing
4674Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestAsIs1SHOTfalsefalse320231214_001702__75700.08.152760[59, 246]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_001702__757.json0.0missingmissingmissing
4675Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestAsIs1SHOTfalsefalse320231225_020349__55900.08.623150[76, 274]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_020349__559.json0.0missing{\n "num_gpu": 99\n}missing
4676Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestAsIs1SHOTfalsefalse320231225_020356__34100.07.388180[76, 233]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_020356__341.json0.0missing{\n "num_gpu": 99\n}missing
4677Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestAsIs1SHOTfalsefalse320231225_160941__66100.010.93520[76, 353]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_160941__661.json0.0missing{\n "num_gpu": 99\n}missing
4678Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestAsIs1SHOTfalsefalse320231225_160946__57500.04.912580[76, 152]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_160946__575.json0.0missing{\n "num_gpu": 99\n}missing
4679Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_020334__10400.04.299722[79, 130]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_020334__104.json75.0missing{\n "num_gpu": 99\n}missing
4680Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_020340__93630.06.434842[79, 201]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_020340__936.json100.0missing{\n "num_gpu": 99\n}missing
4681Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_160920__41100.06.74322[79, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_160920__411.json75.0missing{\n "num_gpu": 99\n}missing
4682Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231225_160930__98900.09.076422[79, 290]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_160930__989.json75.0missing{\n "num_gpu": 99\n}missing
4683Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestInJulia1SHOTtruetrue320231226_225942__95630.06.706322[79, 211]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_225942__956.json100.0missing{\n "num_gpu": 99\n}missing
4684Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_020323__33830.05.409492[121, 162]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_020323__338.json100.0missing{\n "num_gpu": 99\n}missing
4685Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_020329__49130.06.403852[121, 195]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_020329__491.json100.0missing{\n "num_gpu": 99\n}missing
4686Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_160909__21000.05.95572[121, 181]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_160909__210.json75.0missing{\n "num_gpu": 99\n}missing
4687Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231225_160914__27530.04.660732[121, 138]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_160914__275.json100.0missing{\n "num_gpu": 99\n}missing
4688Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertAsk1SHOTtruetrue320231226_225935__94430.05.128132[121, 153]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_225935__944.json100.0missing{\n "num_gpu": 99\n}missing
4689Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue320231225_020304__63200.016.75762[202, 335]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020304__632.json75.0missing{\n "num_gpu": 99\n}missing
4690Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue320231225_020317__77100.013.18622[202, 397]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020317__771.json75.0missing{\n "num_gpu": 99\n}missing
4691Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse320231225_160855__21500.018.21510[202, 391]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160855__215.json25.0missing{\n "num_gpu": 99\n}missing
4692Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue320231225_160903__17830.08.376732[202, 246]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160903__178.json100.0missing{\n "num_gpu": 99\n}missing
4693Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue320231226_225930__37430.014.1792[202, 266]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_225930__374.json100.0missing{\n "num_gpu": 99\n}missing
4694Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_020434__46900.011.02872[388, 294]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020434__469.json75.0missing{\n "num_gpu": 99\n}missing
4695Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_020450__74130.016.04862[388, 450]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_020450__741.json100.0missing{\n "num_gpu": 99\n}missing
4696Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_161017__78230.011.06972[388, 298]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161017__782.json100.0missing{\n "num_gpu": 99\n}missing
4697Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231225_161025__47330.08.427162[388, 214]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161025__473.json100.0missing{\n "num_gpu": 99\n}missing
4698Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue320231226_225959__99500.07.03042[388, 168]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_225959__995.json75.0missing{\n "num_gpu": 99\n}missing
4699Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231225_020409__91100.012.76912[386, 349]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_020409__911.json75.0missing{\n "num_gpu": 99\n}missing
4700Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231225_020423__76800.014.20252[386, 393]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_020423__768.json75.0missing{\n "num_gpu": 99\n}missing
4701Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231225_160954__62100.08.587212[386, 219]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_160954__621.json75.0missing{\n "num_gpu": 99\n}missing
4702Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231225_161006__81300.011.16012[386, 300]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_161006__813.json75.0missing{\n "num_gpu": 99\n}missing
4703Apple-MacBook-Pro-M1FloatWithUnitsstarling-lm:latestJuliaRecapTask1SHOTtruetrue320231226_225952__15730.09.84372[386, 258]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_225952__157.json100.0missing{\n "num_gpu": 99\n}missing
4704Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatAsIs1SHOTfalsefalse320231214_001812__93000.07.711030[59, 233]0.10.0-DEV21.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_001812__930.json0.0missingmissingmissing
4705Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatAsIs1SHOTfalsefalse320231225_020835__39200.054.89160[75, 412]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_020835__392.json0.0missing{\n "num_gpu": 99\n}missing
4706Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatAsIs1SHOTfalsefalse320231225_020949__18100.074.67320[75, 561]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_020949__181.json0.0missing{\n "num_gpu": 99\n}missing
4707Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatAsIs1SHOTfalsefalse320231225_161451__63900.051.80570[75, 391]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_161451__639.json0.0missing{\n "num_gpu": 99\n}missing
4708Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatAsIs1SHOTfalsefalse320231225_161529__75000.037.42820[75, 269]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_161529__750.json0.0missing{\n "num_gpu": 99\n}missing
4709Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruetrue320231225_020704__51700.037.63752[78, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_020704__517.json75.0missing{\n "num_gpu": 99\n}missing
4710Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTfalsefalse320231225_020740__60200.033.92290[78, 247]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_020740__602.json0.0missing{\n "num_gpu": 99\n}missing
4711Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruetrue320231225_161311__67230.051.44772[78, 389]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_161311__672.json100.0missing{\n "num_gpu": 99\n}missing
4712Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTfalsefalse320231225_161359__46500.048.16920[78, 364]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_161359__465.json0.0missing{\n "num_gpu": 99\n}missing
4713Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatInJulia1SHOTtruefalse320231226_230151__45900.057.15220[78, 431]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_230151__459.json25.0missing{\n "num_gpu": 99\n}missing
4714Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruefalse320231225_020608__77000.018.20340[117, 123]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_020608__770.json25.0missing{\n "num_gpu": 99\n}missing
4715Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231225_020626__69030.017.93652[117, 121]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_020626__690.json100.0missing{\n "num_gpu": 99\n}missing
4716Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231225_161204__19930.018.48522[117, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_161204__199.json100.0missing{\n "num_gpu": 99\n}missing
4717Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231225_161220__63830.015.15742[117, 100]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_161220__638.json100.0missing{\n "num_gpu": 99\n}missing
4718Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertAsk1SHOTtruetrue320231226_230054__31830.015.70492[117, 104]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_230054__318.json100.0missing{\n "num_gpu": 99\n}missing
4719Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue320231225_020533__12330.042.70782[197, 109]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020533__123.json100.0missing{\n "num_gpu": 99\n}missing
4720Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse320231225_020550__46500.016.81750[197, 96]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_020550__465.json25.0missing{\n "num_gpu": 99\n}missing
4721Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue320231225_161110__43030.044.9032[197, 132]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161110__430.json100.0missing{\n "num_gpu": 99\n}missing
4722Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse320231225_161146__70900.035.67320[197, 244]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_161146__709.json25.0missing{\n "num_gpu": 99\n}missing
4723Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue320231226_230038__13930.038.88092[197, 94]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_230038__139.json100.0missing{\n "num_gpu": 99\n}missing
4724Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_021155__53430.045.58822[391, 280]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021155__534.json100.0missing{\n "num_gpu": 99\n}missing
4725Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_021232__52230.036.97792[391, 216]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_021232__522.json100.0missing{\n "num_gpu": 99\n}missing
4726Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_161735__66730.017.73262[391, 71]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161735__667.json100.0missing{\n "num_gpu": 99\n}missing
4727Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231225_161848__45030.072.52642[391, 477]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_161848__450.json100.0missing{\n "num_gpu": 99\n}missing
4728Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue320231226_230358__47930.037.53512[391, 221]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_230358__479.json100.0missing{\n "num_gpu": 99\n}missing
4729Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_021039__27930.049.61542[389, 310]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_021039__279.json100.0missing{\n "num_gpu": 99\n}missing
4730Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_021110__79730.030.73912[389, 169]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_021110__797.json100.0missing{\n "num_gpu": 99\n}missing
4731Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_161653__12830.083.93962[389, 556]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_161653__128.json100.0missing{\n "num_gpu": 99\n}missing
4732Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231225_161718__76530.024.78172[389, 126]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_161718__765.json100.0missing{\n "num_gpu": 99\n}missing
4733Apple-MacBook-Pro-M1FloatWithUnitsyi:34b-chatJuliaRecapTask1SHOTtruetrue320231226_230320__47430.088.82422[389, 597]0.10.0-DEV21.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/FloatWithUnits/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_230320__474.json100.0missing{\n "num_gpu": 99\n}missing
4734Apple-MacBook-Pro-M1clean_columncodellama:13b-instructAsIs1SHOTfalsefalse520231214_003202__92000.08.449430[62, 255]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_003202__920.json0.0missingmissingmissing
4735Apple-MacBook-Pro-M1clean_columncodellama:13b-instructAsIs1SHOTfalsefalse520231225_025938__16800.013.33940[84, 239]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_025938__168.json0.0missing{\n "num_gpu": 99\n}missing
4736Apple-MacBook-Pro-M1clean_columncodellama:13b-instructAsIs1SHOTfalsefalse520231225_025954__76300.015.82530[84, 286]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_025954__763.json0.0missing{\n "num_gpu": 99\n}missing
4737Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTfalsefalse520231214_003153__44300.011.19140[79, 332]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_003153__443.json0.0missingmissingmissing
4738Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTtruetrue520231225_025911__61300.06.007180[87, 100]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_025911__613.json50.0missing{\n "num_gpu": 99\n}missing
4739Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTtruetrue520231225_025925__98700.013.82360[87, 248]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_025925__987.json50.0missing{\n "num_gpu": 99\n}missing
4740Apple-MacBook-Pro-M1clean_columncodellama:13b-instructInJulia1SHOTtruetrue520231226_232707__98820.09.900143[87, 175]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_232707__988.json85.0missing{\n "num_gpu": 99\n}missing
4741Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_003142__57300.04.89660[108, 131]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_003142__573.json50.0missingmissingmissing
4742Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_025902__39100.02.804730[125, 34]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_025902__391.json0.0missing{\n "num_gpu": 99\n}missing
4743Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_025905__64830.03.119032[125, 40]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_025905__648.json81.6667missing{\n "num_gpu": 99\n}missing
4744Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_232657__13100.02.849710[125, 35]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_232657__131.json50.0missing{\n "num_gpu": 99\n}missing
4745Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231214_003137__83600.015.24710[184, 412]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003137__836.json0.0missingmissingmissing
4746Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_025855__55600.023.47610[202, 220]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025855__556.json50.0missing{\n "num_gpu": 99\n}missing
4747Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_025859__12700.03.411570[202, 31]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025859__127.json0.0missing{\n "num_gpu": 99\n}missing
4748Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231226_232654__48800.021.90480[202, 200]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232654__488.json0.0missing{\n "num_gpu": 99\n}missing
4749Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_003231__88300.014.48420[11, 398]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003231__883.json50.0missingmissingmissing
4750Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_030040__38400.013.04180[390, 178]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030040__384.json50.0missing{\n "num_gpu": 99\n}missing
4751Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_030100__35600.019.76730[390, 298]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030100__356.json50.0missing{\n "num_gpu": 99\n}missing
4752Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_232736__87850.015.18893[390, 217]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232736__878.json100.0missing{\n "num_gpu": 99\n}missing
4753Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231214_003216__77500.014.43190[379, 312]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_003216__775.json50.0missingmissingmissing
4754Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_030008__59450.014.50093[387, 204]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_030008__594.json100.0missing{\n "num_gpu": 99\n}missing
4755Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_030027__67600.018.72190[387, 280]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_030027__676.json50.0missing{\n "num_gpu": 99\n}missing
4756Apple-MacBook-Pro-M1clean_columncodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_232721__45950.013.82813[387, 193]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_232721__459.json100.0missing{\n "num_gpu": 99\n}missing
4757NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000504__16900.01.798950[0, 137]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000504__169.json50.0missing{\n "num_gpu": 99\n}missing
4758NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000506__31400.01.853980[0, 141]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000506__314.json50.0missing{\n "num_gpu": 99\n}missing
4759NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000508__37600.02.32470[0, 177]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000508__376.json50.0missing{\n "num_gpu": 99\n}missing
4760NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000510__35700.02.127910[0, 162]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000510__357.json50.0missing{\n "num_gpu": 99\n}missing
4761NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_000513__63400.02.670620[0, 203]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000513__634.json0.0missing{\n "num_gpu": 99\n}missing
4762NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000446__46520.01.63633[0, 123]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000446__465.json85.0missing{\n "num_gpu": 99\n}missing
4763NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000448__38900.00.4919660[0, 37]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000448__389.json0.0missing{\n "num_gpu": 99\n}missing
4764NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000448__89620.01.210783[0, 92]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000448__896.json85.0missing{\n "num_gpu": 99\n}missing
4765NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000449__54600.00.5197940[0, 37]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000449__546.json0.0missing{\n "num_gpu": 99\n}missing
4766NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000449__84640.00.5877792[0, 43]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000449__846.json86.6667missing{\n "num_gpu": 99\n}missing
4767NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_000439__96440.04.424322[0, 327]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000439__964.json86.6667missing{\n "num_gpu": 99\n}missing
4768NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000440__27700.00.7261970[0, 53]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000440__277.json0.0missing{\n "num_gpu": 99\n}missing
4769NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000440__76100.00.5044180[0, 37]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000440__761.json0.0missing{\n "num_gpu": 99\n}missing
4770NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000441__46500.00.7207090[0, 53]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000441__465.json0.0missing{\n "num_gpu": 99\n}missing
4771NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_000442__89800.00.7531670[0, 55]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000442__898.json25.0missing{\n "num_gpu": 99\n}missing
4772NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000601__42600.02.408060[0, 178]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000601__426.json50.0missing{\n "num_gpu": 99\n}missing
4773NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000603__14100.01.807250[0, 134]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000603__141.json50.0missing{\n "num_gpu": 99\n}missing
4774NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000610__61200.06.813670[0, 497]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000610__612.json50.0missing{\n "num_gpu": 99\n}missing
4775NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000614__27950.04.161853[0, 306]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000614__279.json100.0missing{\n "num_gpu": 99\n}missing
4776NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_000615__75700.01.294590[0, 96]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000615__757.json0.0missing{\n "num_gpu": 99\n}missing
4777NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000534__65000.03.189310[0, 235]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000534__650.json50.0missing{\n "num_gpu": 99\n}missing
4778NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000537__21500.02.152240[0, 159]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000537__215.json50.0missing{\n "num_gpu": 99\n}missing
4779NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000538__51700.01.635570[0, 121]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000538__517.json50.0missing{\n "num_gpu": 99\n}missing
4780NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000542__21300.03.35790[0, 247]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000542__213.json50.0missing{\n "num_gpu": 99\n}missing
4781NVIDIA-RTX-4090-4xclean_columncodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000546__42200.03.782450[0, 279]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000546__422.json50.0missing{\n "num_gpu": 99\n}missing
4782Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonAsIs1SHOTfalsefalse520231214_003310__77900.06.407780[62, 193]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_003310__779.json0.0missingmissingmissing
4783Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonAsIs1SHOTfalsefalse520231225_030141__42800.01.631050[58, 21]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_030141__428.json0.0missing{\n "num_gpu": 99\n}missing
4784Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonAsIs1SHOTfalsefalse520231225_030143__78000.01.674940[58, 22]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_030143__780.json0.0missing{\n "num_gpu": 99\n}missing
4785Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonInJulia1SHOTfalsefalse520231214_003303__22000.013.9630[79, 413]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_003303__220.json0.0missingmissingmissing
4786Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonInJulia1SHOTfalsefalse520231225_030135__93100.04.123220[61, 69]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_030135__931.json0.0missing{\n "num_gpu": 99\n}missing
4787Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonInJulia1SHOTfalsefalse520231225_030139__70200.03.92060[61, 65]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_030139__702.json0.0missing{\n "num_gpu": 99\n}missing
4788Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_003249__95800.05.447910[108, 148]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_003249__958.json0.0missingmissingmissing
4789Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_030121__76000.04.434390[62, 75]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_030121__760.json0.0missing{\n "num_gpu": 99\n}missing
4790Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_030131__18100.010.7150[62, 195]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_030131__181.json0.0missing{\n "num_gpu": 99\n}missing
4791Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_003244__65400.012.73060[184, 341]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003244__654.json50.0missingmissingmissing
4792Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_030113__96600.012.91260[77, 41]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030113__966.json0.0missing{\n "num_gpu": 99\n}missing
4793Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_030116__99000.02.876170[77, 40]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030116__990.json0.0missing{\n "num_gpu": 99\n}missing
4794Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231214_003339__89900.011.61740[11, 322]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003339__899.json0.0missingmissingmissing
4795Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_030159__28400.00.8577510[79, 1]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030159__284.json0.0missing{\n "num_gpu": 99\n}missing
4796Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_030200__75500.01.319220[79, 10]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030200__755.json0.0missing{\n "num_gpu": 99\n}missing
4797Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_003327__69900.017.70370[379, 399]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_003327__699.json0.0missingmissingmissing
4798Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_030145__25400.01.89310[76, 21]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_030145__254.json0.0missing{\n "num_gpu": 99\n}missing
4799Apple-MacBook-Pro-M1clean_columncodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_030158__55300.013.14110[76, 236]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_030158__553.json0.0missing{\n "num_gpu": 99\n}missing
4800NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_000942__65200.08.313550[0, 300]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000942__652.json0.0missing{\n "num_gpu": 99\n}missing
4801NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000950__93100.07.226720[0, 261]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000950__931.json50.0missing{\n "num_gpu": 99\n}missing
4802NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000951__23000.01.490960[0, 54]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000951__230.json50.0missing{\n "num_gpu": 99\n}missing
4803NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000955__61000.03.646710[0, 132]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000955__610.json50.0missing{\n "num_gpu": 99\n}missing
4804NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_001002__51400.06.956940[0, 251]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_001002__514.json50.0missing{\n "num_gpu": 99\n}missing
4805NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000844__34800.00.8159790[0, 29]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000844__348.json0.0missing{\n "num_gpu": 99\n}missing
4806NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000849__54040.05.256262[0, 187]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000849__540.json86.6667missing{\n "num_gpu": 99\n}missing
4807NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000852__30800.02.911260[0, 104]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000852__308.json50.0missing{\n "num_gpu": 99\n}missing
4808NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000857__70700.04.764870[0, 170]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000857__707.json50.0missing{\n "num_gpu": 99\n}missing
4809NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_000903__95100.05.789010[0, 206]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000903__951.json50.0missing{\n "num_gpu": 99\n}missing
4810NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000814__48800.01.433520[0, 51]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000814__488.json0.0missing{\n "num_gpu": 99\n}missing
4811NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_000819__50600.04.982210[0, 176]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000819__506.json50.0missing{\n "num_gpu": 99\n}missing
4812NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000820__32000.01.417120[0, 51]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000820__320.json0.0missing{\n "num_gpu": 99\n}missing
4813NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_000823__69600.02.466462[0, 89]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000823__696.json66.6667missing{\n "num_gpu": 99\n}missing
4814NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000827__61500.04.137510[0, 149]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000827__615.json0.0missing{\n "num_gpu": 99\n}missing
4815NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_001112__95150.011.02643[0, 392]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_001112__951.json100.0missing{\n "num_gpu": 99\n}missing
4816NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_001121__56500.08.199610[0, 292]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_001121__565.json0.0missing{\n "num_gpu": 99\n}missing
4817NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_001128__96100.07.014340[0, 250]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_001128__961.json50.0missing{\n "num_gpu": 99\n}missing
4818NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_001131__50900.02.734430[0, 98]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_001131__509.json0.0missing{\n "num_gpu": 99\n}missing
4819NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_001142__15600.011.2350[0, 399]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_001142__156.json0.0missing{\n "num_gpu": 99\n}missing
4820NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_001015__94500.01.423370[0, 51]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_001015__945.json0.0missing{\n "num_gpu": 99\n}missing
4821NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_001018__63000.02.872260[0, 103]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_001018__630.json0.0missing{\n "num_gpu": 99\n}missing
4822NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_001019__70000.01.173570[0, 42]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_001019__700.json0.0missing{\n "num_gpu": 99\n}missing
4823NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_001034__69600.014.92130[0, 529]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_001034__696.json0.0missing{\n "num_gpu": 99\n}missing
4824NVIDIA-RTX-4090-4xclean_columncodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_001036__51700.01.424570[0, 51]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_001036__517.json0.0missing{\n "num_gpu": 99\n}missing
4825NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_000015__56440.08.044152[0, 198]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_000015__564.json86.6667missing{\n "num_gpu": 99\n}missing
4826NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_000029__72240.014.05862[0, 346]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_000029__722.json86.6667missing{\n "num_gpu": 99\n}missing
4827NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_000037__35740.07.696342[0, 190]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_000037__357.json86.6667missing{\n "num_gpu": 99\n}missing
4828NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_000049__75650.011.98243[0, 295]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_000049__756.json100.0missing{\n "num_gpu": 99\n}missing
4829NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_000058__27900.09.125180[0, 225]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_000058__279.json50.0missing{\n "num_gpu": 99\n}missing
4830NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240131_235853__45850.04.655513[0, 115]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_235853__458.json100.0missing{\n "num_gpu": 99\n}missing
4831NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240131_235900__66340.06.648062[0, 164]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_235900__663.json86.6667missing{\n "num_gpu": 99\n}missing
4832NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_235908__94400.07.994740[0, 197]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_235908__944.json0.0missing{\n "num_gpu": 99\n}missing
4833NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_235915__64900.06.898610[0, 170]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_235915__649.json0.0missing{\n "num_gpu": 99\n}missing
4834NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240131_235923__35200.07.794560[0, 192]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240131_235923__352.json0.0missing{\n "num_gpu": 99\n}missing
4835NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_235730__26200.010.16320[0, 249]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_235730__262.json0.0missing{\n "num_gpu": 99\n}missing
4836NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_235734__32300.04.473330[0, 110]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_235734__323.json0.0missing{\n "num_gpu": 99\n}missing
4837NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240131_235744__28500.010.06740[0, 247]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_235744__285.json0.0missing{\n "num_gpu": 99\n}missing
4838NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_235756__99740.011.36642[0, 279]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_235756__997.json86.6667missing{\n "num_gpu": 99\n}missing
4839NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240131_235810__68550.014.34023[0, 351]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240131_235810__685.json100.0missing{\n "num_gpu": 99\n}missing
4840NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_000340__96110.09.1933[0, 223]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000340__961.json80.0missing{\n "num_gpu": 99\n}missing
4841NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_000347__18800.07.158540[0, 174]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000347__188.json0.0missing{\n "num_gpu": 99\n}missing
4842NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_000403__70940.015.7132[0, 380]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000403__709.json86.6667missing{\n "num_gpu": 99\n}missing
4843NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_000409__46550.06.204673[0, 151]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000409__465.json100.0missing{\n "num_gpu": 99\n}missing
4844NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_000419__33300.09.445340[0, 229]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000419__333.json0.0missing{\n "num_gpu": 99\n}missing
4845NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_000208__13050.09.263973[0, 222]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_000208__130.json100.0missing{\n "num_gpu": 99\n}missing
4846NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_000216__49300.08.436330[0, 205]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_000216__493.json0.0missing{\n "num_gpu": 99\n}missing
4847NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_000224__47350.08.141433[0, 198]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_000224__473.json100.0missing{\n "num_gpu": 99\n}missing
4848NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_000234__27150.010.00793[0, 243]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_000234__271.json100.0missing{\n "num_gpu": 99\n}missing
4849NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_000240__37150.05.204813[0, 127]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_000240__371.json100.0missing{\n "num_gpu": 99\n}missing
4850NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_235153__88150.018.56893[0, 347]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_235153__881.json100.0missing{\n "num_gpu": 99\n}missing
4851NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_235157__80800.04.347610[0, 81]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_235157__808.json0.0missing{\n "num_gpu": 99\n}missing
4852NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_235208__21950.011.37773[0, 213]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_235208__219.json100.0missing{\n "num_gpu": 99\n}missing
4853NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240131_235216__13000.07.375180[0, 138]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_235216__130.json0.0missing{\n "num_gpu": 99\n}missing
4854NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240131_235230__23050.014.00443[0, 262]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240131_235230__230.json100.0missing{\n "num_gpu": 99\n}missing
4855NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_235012__21340.013.98392[0, 261]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_235012__213.json86.6667missing{\n "num_gpu": 99\n}missing
4856NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_235023__41900.011.14680[0, 208]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_235023__419.json0.0missing{\n "num_gpu": 99\n}missing
4857NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240131_235035__51450.012.14563[0, 227]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_235035__514.json100.0missing{\n "num_gpu": 99\n}missing
4858NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_235041__28100.06.357070[0, 119]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_235041__281.json0.0missing{\n "num_gpu": 99\n}missing
4859NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240131_235049__20400.08.064030[0, 151]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240131_235049__204.json0.0missing{\n "num_gpu": 99\n}missing
4860NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_234832__84500.012.71070[0, 235]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234832__845.json0.0missing{\n "num_gpu": 99\n}missing
4861NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_234842__97300.010.27070[0, 191]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234842__973.json0.0missing{\n "num_gpu": 99\n}missing
4862NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_234850__75400.08.142940[0, 152]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234850__754.json0.0missing{\n "num_gpu": 99\n}missing
4863NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_234858__99000.08.189810[0, 153]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234858__990.json0.0missing{\n "num_gpu": 99\n}missing
4864NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240131_234912__48800.013.79730[0, 257]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240131_234912__488.json0.0missing{\n "num_gpu": 99\n}missing
4865NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_235536__35340.010.75912[0, 199]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_235536__353.json86.6667missing{\n "num_gpu": 99\n}missing
4866NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_235542__28050.06.507223[0, 121]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_235542__280.json100.0missing{\n "num_gpu": 99\n}missing
4867NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_235552__32550.010.07763[0, 187]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_235552__325.json100.0missing{\n "num_gpu": 99\n}missing
4868NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_235607__97740.015.15742[0, 279]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_235607__977.json86.6667missing{\n "num_gpu": 99\n}missing
4869NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240131_235616__43540.08.972262[0, 166]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240131_235616__435.json86.6667missing{\n "num_gpu": 99\n}missing
4870NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_235328__28250.08.0973[0, 150]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_235328__282.json100.0missing{\n "num_gpu": 99\n}missing
4871NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_235341__69050.012.93613[0, 239]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_235341__690.json100.0missing{\n "num_gpu": 99\n}missing
4872NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_235358__26450.017.28563[0, 319]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_235358__264.json100.0missing{\n "num_gpu": 99\n}missing
4873NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_235406__54940.07.787533[0, 144]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_235406__549.json95.0missing{\n "num_gpu": 99\n}missing
4874NVIDIA-RTX-4090-4xclean_columncodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240131_235418__48750.012.65733[0, 234]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240131_235418__487.json100.0missing{\n "num_gpu": 99\n}missing
4875NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000643__86700.01.793010[0, 215]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000643__867.json50.0missing{\n "num_gpu": 99\n}missing
4876NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000644__47200.01.456340[0, 175]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000644__472.json50.0missing{\n "num_gpu": 99\n}missing
4877NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000646__53200.01.466880[0, 176]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000646__532.json50.0missing{\n "num_gpu": 99\n}missing
4878NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_000647__70600.01.466490[0, 169]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000647__706.json50.0missing{\n "num_gpu": 99\n}missing
4879NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_000648__93400.00.2657920[0, 30]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_000648__934.json0.0missing{\n "num_gpu": 99\n}missing
4880NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000632__34000.00.2426330[0, 29]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000632__340.json0.0missing{\n "num_gpu": 99\n}missing
4881NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000632__37200.00.2441060[0, 29]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000632__372.json0.0missing{\n "num_gpu": 99\n}missing
4882NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000632__70500.00.242420[0, 29]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000632__705.json0.0missing{\n "num_gpu": 99\n}missing
4883NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000632__73600.00.2417910[0, 29]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000632__736.json0.0missing{\n "num_gpu": 99\n}missing
4884NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_000633__67200.00.242630[0, 29]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_000633__672.json0.0missing{\n "num_gpu": 99\n}missing
4885NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000625__84600.01.097910[0, 131]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000625__846.json0.0missing{\n "num_gpu": 99\n}missing
4886NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_000626__23800.00.8334010[0, 99]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000626__238.json0.0missing{\n "num_gpu": 99\n}missing
4887NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_000626__80500.00.7494860[0, 90]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000626__805.json50.0missing{\n "num_gpu": 99\n}missing
4888NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_000627__41600.00.7514440[0, 90]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000627__416.json50.0missing{\n "num_gpu": 99\n}missing
4889NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_000628__38500.00.410150[0, 49]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_000628__385.json50.0missing{\n "num_gpu": 99\n}missing
4890NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000722__67600.01.764020[0, 207]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000722__676.json50.0missing{\n "num_gpu": 99\n}missing
4891NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000724__76100.01.913040[0, 224]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000724__761.json50.0missing{\n "num_gpu": 99\n}missing
4892NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000727__99200.02.224530[0, 263]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000727__992.json50.0missing{\n "num_gpu": 99\n}missing
4893NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000730__64700.02.796350[0, 327]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000730__647.json50.0missing{\n "num_gpu": 99\n}missing
4894NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_000732__95400.02.342170[0, 274]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_000732__954.json50.0missing{\n "num_gpu": 99\n}missing
4895NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000703__19500.05.057490[0, 569]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000703__195.json50.0missing{\n "num_gpu": 99\n}missing
4896NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000706__97000.01.919840[0, 215]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000706__970.json50.0missing{\n "num_gpu": 99\n}missing
4897NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000708__49900.02.780210[0, 309]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000708__499.json50.0missing{\n "num_gpu": 99\n}missing
4898NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000709__18200.00.3805930[0, 43]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000709__182.json50.0missing{\n "num_gpu": 99\n}missing
4899NVIDIA-RTX-4090-4xclean_columncodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_000709__36900.00.3805150[0, 43]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_000709__369.json50.0missing{\n "num_gpu": 99\n}missing
4900Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_225959__93700.06.116450[62, 184]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_225959__937.json0.0missingmissingmissing
4901Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_230008__68100.09.33890[1, 295]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_230008__681.json0.0missingmissingmissing
4902Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_230014__46000.05.742260[1, 185]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_230014__460.json0.0missingmissingmissing
4903Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_031525__55800.027.55330[76, 160]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_031525__558.json0.0missing{\n "num_gpu": 99\n}missing
4904Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_031549__29700.023.64980[76, 136]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_031549__297.json0.0missing{\n "num_gpu": 99\n}missing
4905Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231219_225943__73400.011.64480[1, 363]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_225943__734.json50.0missingmissingmissing
4906Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_225952__96200.09.138870[1, 289]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_225952__962.json0.0missingmissingmissing
4907Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_031420__69350.043.06733[79, 257]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_031420__693.json100.0missing{\n "num_gpu": 99\n}missing
4908Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_031457__43350.037.03073[79, 219]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_031457__433.json100.0missing{\n "num_gpu": 99\n}missing
4909Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_233403__34140.023.76522[79, 136]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_233403__341.json86.6667missing{\n "num_gpu": 99\n}missing
4910Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_225908__98300.010.39140[1, 322]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_225908__983.json50.0missingmissingmissing
4911Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_225915__61300.07.621560[1, 240]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_225915__613.json50.0missingmissingmissing
4912Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_031323__46000.032.60240[120, 185]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_031323__460.json0.0missing{\n "num_gpu": 99\n}missing
4913Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_031337__77700.013.91640[120, 69]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_031337__777.json0.0missing{\n "num_gpu": 99\n}missing
4914Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_233339__19800.044.5820[120, 262]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233339__198.json0.0missing{\n "num_gpu": 99\n}missing
4915Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_225844__42400.012.07720[1, 362]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_225844__424.json0.0missingmissingmissing
4916Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_225852__79700.08.05210[1, 246]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_225852__797.json50.0missingmissingmissing
4917Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_031233__28250.048.53713[196, 93]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_031233__282.json100.0missing{\n "num_gpu": 99\n}missing
4918Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_031250__81600.017.180[196, 75]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_031250__816.json0.0missing{\n "num_gpu": 99\n}missing
4919Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231226_233255__96100.049.84790[196, 135]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233255__961.json0.0missing{\n "num_gpu": 99\n}missing
4920Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230142__40800.016.72980[1, 464]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230142__408.json50.0missingmissingmissing
4921Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230159__19100.017.15450[1, 475]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230159__191.json50.0missingmissingmissing
4922Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_031754__47040.038.37193[408, 174]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031754__470.json95.0missing{\n "num_gpu": 99\n}missing
4923Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_031825__42150.030.8253[408, 128]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031825__421.json100.0missing{\n "num_gpu": 99\n}missing
4924Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233541__27740.034.15992[408, 149]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233541__277.json86.6667missing{\n "num_gpu": 99\n}missing
4925Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_230053__91500.018.57750[1, 512]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230053__915.json50.0missingmissingmissing
4926Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_230112__78900.018.98010[1, 522]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230112__789.json50.0missingmissingmissing
4927Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_031633__65940.043.73543[406, 206]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_031633__659.json95.0missing{\n "num_gpu": 99\n}missing
4928Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_031715__87950.041.92023[406, 195]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_031715__879.json100.0missing{\n "num_gpu": 99\n}missing
4929Apple-MacBook-Pro-M1clean_columndeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233507__29240.063.00823[406, 323]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233507__292.json95.0missing{\n "num_gpu": 99\n}missing
4930Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231226_234106__53500.07.57760[78, 291]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231226_234106__535.json50.0missing{\n "num_gpu": 99\n}missing
4931Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_111332__62900.05.448290[78, 208]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_111332__629.json0.0missing{\n "num_gpu": 99\n}missing
4932Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_111337__32500.05.590570[78, 214]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_111337__325.json50.0missing{\n "num_gpu": 99\n}missing
4933Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_111342__90100.05.303030[78, 203]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_111342__901.json50.0missing{\n "num_gpu": 99\n}missing
4934Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231226_234058__26400.07.248330[115, 273]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_234058__264.json50.0missing{\n "num_gpu": 99\n}missing
4935Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_111318__64700.01.444520[115, 45]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_111318__647.json0.0missing{\n "num_gpu": 99\n}missing
4936Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_111325__96500.06.157280[115, 231]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_111325__965.json0.0missing{\n "num_gpu": 99\n}missing
4937Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_111326__16600.01.41340[115, 44]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_111326__166.json0.0missing{\n "num_gpu": 99\n}missing
4938Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_234051__62400.05.408310[189, 58]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234051__624.json0.0missing{\n "num_gpu": 99\n}missing
4939Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_111308__97300.05.477140[189, 67]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111308__973.json0.0missing{\n "num_gpu": 99\n}missing
4940Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_111312__77000.04.205160[189, 145]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111312__770.json50.0missing{\n "num_gpu": 99\n}missing
4941Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_111317__39200.04.925510[189, 172]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111317__392.json0.0missing{\n "num_gpu": 99\n}missing
4942Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_234120__94500.03.685420[367, 95]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234120__945.json0.0missing{\n "num_gpu": 99\n}missing
4943Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_111406__27100.03.524260[367, 89]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111406__271.json0.0missing{\n "num_gpu": 99\n}missing
4944Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_111413__71100.06.177450[367, 188]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111413__711.json0.0missing{\n "num_gpu": 99\n}missing
4945Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_111422__35900.09.248370[367, 301]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_111422__359.json50.0missing{\n "num_gpu": 99\n}missing
4946Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231226_234116__93900.010.08070[364, 331]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_234116__939.json0.0missing{\n "num_gpu": 99\n}missing
4947Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_111350__23900.07.414230[364, 234]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_111350__239.json50.0missing{\n "num_gpu": 99\n}missing
4948Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_111354__40600.04.152470[364, 113]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_111354__406.json0.0missing{\n "num_gpu": 99\n}missing
4949Apple-MacBook-Pro-M1clean_columndolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_111403__65500.08.709990[364, 282]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_111403__655.json0.0missing{\n "num_gpu": 99\n}missing
4950Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_105859__55400.06.260180[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105859__554.json25.0missingmissingmissing
4951Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_105902__89000.03.128960[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105902__890.json50.0missingmissingmissing
4952Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_105910__61300.07.931030[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105910__613.json50.0missingmissingmissing
4953Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_105913__10500.03.152270[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105913__105.json50.0missingmissingmissing
4954Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_105915__82600.01.868520[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_105915__826.json50.0missingmissingmissing
4955Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_105830__87100.01.669190[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105830__871.json0.0missingmissingmissing
4956Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105832__23500.01.895380[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105832__235.json50.0missingmissingmissing
4957Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105834__97900.01.660950[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105834__979.json50.0missingmissingmissing
4958Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105835__85700.01.632190[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105835__857.json50.0missingmissingmissing
4959Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_105839__13600.03.450370[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_105839__136.json50.0missingmissingmissing
4960Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_105803__16000.02.690490[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105803__160.json50.0missingmissingmissing
4961Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_105806__36100.02.602730[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105806__361.json50.0missingmissingmissing
4962Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_105809__88840.02.546552[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105809__888.json86.6667missingmissingmissing
4963Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_105811__66200.02.537870[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105811__662.json50.0missingmissingmissing
4964Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_105816__21000.04.285070[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_105816__210.json50.0missingmissingmissing
4965Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_110002__94500.02.629190[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110002__945.json25.0missingmissingmissing
4966Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_110004__68000.01.791110[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110004__680.json25.0missingmissingmissing
4967Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_110006__34900.02.455480[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110006__349.json0.0missingmissingmissing
4968Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110008__24200.01.93290[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110008__242.json50.0missingmissingmissing
4969Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110011__65100.02.444960[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110011__651.json50.0missingmissingmissing
4970Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_105936__22000.02.045490[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105936__220.json50.0missingmissingmissing
4971Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_105939__27600.02.335420[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105939__276.json25.0missingmissingmissing
4972Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_105940__34140.01.780143[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105940__341.json95.0missingmissingmissing
4973Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_105942__69700.01.706440[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105942__697.json50.0missingmissingmissing
4974Apple-MacBook-Pro-M1clean_columngemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_105944__55300.01.95040[0, 0]0.13.0-DEV31.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_105944__553.json25.0missingmissingmissing
4975Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_224023__93500.019.52240[0, 299]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_224023__935.json50.0missingmissingmissing
4976Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_224037__81800.014.59820[0, 220]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_224037__818.json50.0missingmissingmissing
4977Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_224057__80100.019.7140[0, 302]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_224057__801.json50.0missingmissingmissing
4978Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_224116__81900.019.27930[0, 296]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_224116__819.json50.0missingmissingmissing
4979Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_224139__44300.022.24730[0, 335]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_224139__443.json50.0missingmissingmissing
4980Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_223825__32300.01.779380[0, 27]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_223825__323.json50.0missingmissingmissing
4981Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_223826__85300.01.705810[0, 25]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_223826__853.json0.0missingmissingmissing
4982Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_223828__26100.01.965440[0, 28]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_223828__261.json50.0missingmissingmissing
4983Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_223830__23000.02.098820[0, 31]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_223830__230.json0.0missingmissingmissing
4984Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_223832__50600.01.608670[0, 25]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_223832__506.json0.0missingmissingmissing
4985Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_223637__22400.023.1190[0, 355]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_223637__224.json25.0missingmissingmissing
4986Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_223657__34300.019.39760[0, 298]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_223657__343.json25.0missingmissingmissing
4987Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_223719__22100.022.05890[0, 337]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_223719__221.json25.0missingmissingmissing
4988Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_223741__81900.022.32750[0, 337]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_223741__819.json25.0missingmissingmissing
4989Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_223802__74900.021.3240[0, 325]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_223802__749.json25.0missingmissingmissing
4990Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_224707__24100.022.6420[0, 345]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_224707__241.json50.0missingmissingmissing
4991Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_224724__15300.017.1080[0, 262]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_224724__153.json50.0missingmissingmissing
4992Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_224748__24200.023.830[0, 363]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_224748__242.json50.0missingmissingmissing
4993Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_224809__27100.021.74060[0, 327]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_224809__271.json50.0missingmissingmissing
4994Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_224828__76400.018.34030[0, 279]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_224828__764.json50.0missingmissingmissing
4995Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_224345__61100.021.61640[0, 328]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_224345__611.json50.0missingmissingmissing
4996Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_224405__39200.020.7960[0, 317]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_224405__392.json50.0missingmissingmissing
4997Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_224425__42900.019.97290[0, 301]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_224425__429.json0.0missingmissingmissing
4998Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_224448__16300.022.82850[0, 342]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_224448__163.json50.0missingmissingmissing
4999Apple-MacBook-Pro-M1clean_columngemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_224506__46400.017.91690[0, 272]0.13.0-DEV31.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_224506__464.json50.0missingmissingmissing
5000Apple-MacBook-Pro-M1clean_columngpt-3.5-turboAsIs1SHOTfalsefalse520231213_202043__78300.00031955.489440[69, 190]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_202043__783.json0.0missingmissingmissing
5001Apple-MacBook-Pro-M1clean_columngpt-3.5-turboAsIs1SHOTfalsefalse520231225_190744__67600.0002552.80650[69, 147]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_190744__676.json0.0missingmissingmissing
5002Apple-MacBook-Pro-M1clean_columngpt-3.5-turboAsIs1SHOTfalsefalse520231225_190747__94500.00031052.945620[69, 184]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_190747__945.json0.0missingmissingmissing
5003Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_193143__31300.03.648790[69, 153]0.10.0-DEV31.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_193143__313.json0.00.5missing0.5
5004Apple-MacBook-Pro-M1clean_columngpt-3.5-turboInJulia1SHOTtruetrue520231213_202038__49750.0002433.367943[72, 138]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_202038__497.json100.0missingmissingmissing
5005Apple-MacBook-Pro-M1clean_columngpt-3.5-turboInJulia1SHOTtruetrue520231225_190739__18250.0003033.037773[72, 178]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_190739__182.json100.0missingmissingmissing
5006Apple-MacBook-Pro-M1clean_columngpt-3.5-turboInJulia1SHOTtruetrue520231225_190741__95350.0002972.615483[72, 174]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_190741__953.json100.0missingmissingmissing
5007Apple-MacBook-Pro-M1clean_columngpt-3.5-turboInJulia1SHOTtruetrue520231227_194302__79050.0002522.743813[72, 144]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_194302__790.json100.0missingmissingmissing
5008Apple-MacBook-Pro-M1clean_columngpt-3.5-turboInJulia1SHOTtruetrue520231227_194305__62650.00034053.337333[72, 203]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_194305__626.json100.0missingmissingmissing
5009Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_193140__93950.03.750063[72, 153]0.10.0-DEV31.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_193140__939.json100.00.5missing0.5
5010Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_202034__31500.00015552.390580[107, 68]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_202034__315.json50.0missingmissingmissing
5011Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_190734__99140.00013451.313372[107, 54]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_190734__991.json86.6667missingmissingmissing
5012Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_190736__63300.0001781.584010[107, 83]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_190736__633.json50.0missingmissingmissing
5013Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_194258__78300.0001211.013650[107, 45]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_194258__783.json50.0missingmissingmissing
5014Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_194259__91650.00010751.148033[107, 36]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_194259__916.json100.0missingmissingmissing
5015Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_193136__19450.01.41853[107, 44]0.10.0-DEV31.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_193136__194.json100.00.5missing0.5
5016Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_202032__36100.00016451.484280[170, 53]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202032__361.json0.0missingmissingmissing
5017Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_190732__34800.00013751.022040[170, 35]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190732__348.json0.0missingmissingmissing
5018Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_190733__92000.00015850.9405240[170, 49]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190733__920.json0.0missingmissingmissing
5019Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_194255__54300.00024251.999590[170, 105]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194255__543.json0.0missingmissingmissing
5020Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_194257__20700.0001631.132590[170, 52]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194257__207.json0.0missingmissingmissing
5021Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_193135__75800.01.738210[170, 69]0.10.0-DEV31.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193135__758.json0.00.5missing0.5
5022Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231213_202048__61700.0002822.266760[330, 78]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202048__617.json0.0missingmissingmissing
5023Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_190753__95900.0003632.79890[330, 132]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190753__959.json0.0missingmissingmissing
5024Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_190755__40400.00031952.117740[330, 103]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190755__404.json0.0missingmissingmissing
5025Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_194310__66200.00027151.449650[330, 71]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194310__662.json0.0missingmissingmissing
5026Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_194313__51400.0003782.888050[330, 142]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194313__514.json50.0missingmissingmissing
5027Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_193147__39500.01.759080[330, 73]0.10.0-DEV31.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193147__395.json0.00.5missing0.5
5028Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_202046__61900.0002712.08210[329, 71]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_202046__619.json0.0missingmissingmissing
5029Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_190748__74100.00024851.09930[329, 56]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_190748__741.json0.0missingmissingmissing
5030Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_190750__23300.0002561.462560[329, 61]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_190750__233.json0.0missingmissingmissing
5031Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_194307__75800.00026951.600470[329, 70]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_194307__758.json0.0missingmissingmissing
5032Apple-MacBook-Pro-M1clean_columngpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_194308__89200.00027551.655710[329, 74]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_194308__892.json0.0missingmissingmissing
5033Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_193145__47400.01.976390[329, 74]0.10.0-DEV31.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_193145__474.json0.00.5missing0.5
5034Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200339__88140.0001980.9406212[72, 108]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200339__881.json86.6667missingmissingmissing
5035Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125InJulia1SHOTtruefalse520240201_200340__15600.00023851.042650[72, 135]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200340__156.json25.0missingmissingmissing
5036Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200341__54440.00020550.9914822[72, 113]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200341__544.json86.6667missingmissingmissing
5037Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200342__68840.0001920.8668822[72, 104]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200342__688.json86.6667missingmissingmissing
5038Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200343__20740.000211.002232[72, 116]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200343__207.json86.6667missingmissingmissing
5039Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200336__30930.0001090.5287772[107, 37]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200336__309.json81.6667missingmissingmissing
5040Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200336__96440.0001060.7275252[107, 35]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200336__964.json86.6667missingmissingmissing
5041Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200337__36740.0001060.4665452[107, 35]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200337__367.json86.6667missingmissingmissing
5042Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200337__65440.00011050.7375862[107, 38]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200337__654.json86.6667missingmissingmissing
5043Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200338__23749.1e-50.6636712[107, 25]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200338__237.json86.6667missingmissingmissing
5044Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200332__29100.00019150.8779480[170, 71]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200332__291.json0.0missingmissingmissing
5045Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200332__58500.0001660.5658060[170, 54]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200332__585.json0.0missingmissingmissing
5046Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200333__21740.0001870.9919372[170, 68]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200333__217.json86.6667missingmissingmissing
5047Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200334__19940.00014350.6993452[170, 39]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200334__199.json86.6667missingmissingmissing
5048Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200335__82800.0001690.7862830[170, 56]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200335__828.json0.0missingmissingmissing
5049Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200349__88940.00033451.151643[330, 113]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200349__889.json95.0missingmissingmissing
5050Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200350__11050.00029250.878773[330, 85]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200350__110.json100.0missingmissingmissing
5051Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200351__61900.00025650.8185870[330, 61]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200351__619.json0.0missingmissingmissing
5052Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200352__63250.0003961.395113[330, 154]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200352__632.json100.0missingmissingmissing
5053Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200354__19600.0003691.294730[330, 136]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200354__196.json0.0missingmissingmissing
5054Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200344__24500.0003191.081480[329, 103]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200344__245.json50.0missingmissingmissing
5055Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200345__91500.0003581.031440[329, 129]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200345__915.json50.0missingmissingmissing
5056Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200346__37350.0002230.5008273[329, 39]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200346__373.json100.0missingmissingmissing
5057Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200347__72400.00040151.268160[329, 158]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200347__724.json50.0missingmissingmissing
5058Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200348__93400.00022150.6939280[329, 38]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200348__934.json50.0missingmissingmissing
5059Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_202100__67400.0003774.200560[69, 154]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_202100__674.json0.0missingmissingmissing
5060Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_190805__21200.0004073.03460[69, 169]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_190805__212.json0.0missingmissingmissing
5061Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_190807__57700.0002851.636140[69, 108]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_190807__577.json0.0missingmissingmissing
5062Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_193156__16100.02.738650[69, 99]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_193156__161.json0.00.9missing0.1
5063Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_202055__94040.000393.392412[72, 159]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_202055__940.json86.6667missingmissingmissing
5064Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_190801__86050.0002521.640263[72, 90]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_190801__860.json100.0missingmissingmissing
5065Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_190802__42540.0002541.545452[72, 91]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_190802__425.json86.6667missingmissingmissing
5066Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_194321__84930.0003182.726222[72, 123]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_194321__849.json81.6667missingmissingmissing
5067Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_194324__67840.0003822.762322[72, 155]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_194324__678.json86.6667missingmissingmissing
5068Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_193154__43440.01.729572[72, 74]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_193154__434.json86.66670.9missing0.1
5069Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_202052__82040.0001792.058262[107, 36]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_202052__820.json86.6667missingmissingmissing
5070Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_190758__61240.0001790.9400012[107, 36]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_190758__612.json86.6667missingmissingmissing
5071Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_190759__99640.0001770.6983472[107, 35]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_190759__996.json86.6667missingmissingmissing
5072Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_194317__11040.0001751.283672[107, 34]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_194317__110.json86.6667missingmissingmissing
5073Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_194318__81150.0001891.060313[107, 41]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_194318__811.json100.0missingmissingmissing
5074Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_193152__22340.02.166812[107, 31]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_193152__223.json86.66670.9missing0.1
5075Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_202049__19650.0002981.560643[170, 64]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202049__196.json100.0missingmissingmissing
5076Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_190756__66750.0003081.078833[170, 69]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190756__667.json100.0missingmissingmissing
5077Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_190757__91750.0002841.205533[170, 57]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190757__917.json100.0missingmissingmissing
5078Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_194314__24640.000271.079692[170, 50]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194314__246.json86.6667missingmissingmissing
5079Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_194316__57700.0002742.001840[170, 52]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194316__577.json25.0missingmissingmissing
5080Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193150__22940.02.503292[170, 50]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193150__229.json86.66670.9missing0.1
5081Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231213_202105__83640.000663.32293[330, 165]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202105__836.json95.0missingmissingmissing
5082Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_190811__98900.0005281.818980[330, 99]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190811__989.json0.0missingmissingmissing
5083Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_190813__60100.00051.427480[330, 85]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_190813__601.json0.0missingmissingmissing
5084Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_194328__88800.0004661.416990[330, 68]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194328__888.json0.0missingmissingmissing
5085Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_194330__34500.0006282.473090[330, 149]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194330__345.json0.0missingmissingmissing
5086Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_193159__39700.01.313520[330, 58]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193159__397.json0.00.9missing0.1
5087Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_202102__20750.0004952.270263[329, 83]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_202102__207.json100.0missingmissingmissing
5088Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_190808__18300.0004151.114730[329, 43]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_190808__183.json50.0missingmissingmissing
5089Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_190809__82950.0004211.000463[329, 46]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_190809__829.json100.0missingmissingmissing
5090Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_194325__40200.0004211.078370[329, 46]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_194325__402.json50.0missingmissingmissing
5091Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_194326__39100.0004191.212890[329, 45]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_194326__391.json50.0missingmissingmissing
5092Apple-MacBook-Pro-M1clean_columngpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_193158__84750.01.339473[329, 55]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_193158__847.json100.00.9missing0.1
5093Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewInJulia1SHOTtruetrue520240201_084214__28040.0083417.15312[72, 254]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_084214__280.json86.6667missingmissingmissing
5094Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewInJulia1SHOTtruetrue520240201_084245__35740.0091530.58182[72, 281]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_084245__357.json86.6667missingmissingmissing
5095Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewInJulia1SHOTtruetrue520240201_084304__43740.0088519.60412[72, 271]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_084304__437.json86.6667missingmissingmissing
5096Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewInJulia1SHOTtruetrue520240201_084327__92640.0113422.59532[72, 354]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_084327__926.json86.6667missingmissingmissing
5097Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewInJulia1SHOTtruetrue520240201_084350__95440.0111923.22442[72, 349]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_084350__954.json86.6667missingmissingmissing
5098Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_083932__76040.0022.501342[107, 31]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_083932__760.json86.6667missingmissingmissing
5099Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_083936__30840.00263.834082[107, 51]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_083936__308.json86.6667missingmissingmissing
5100Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_083939__57840.001942.622642[107, 29]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_083939__578.json86.6667missingmissingmissing
5101Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_083941__75940.0022.470222[107, 31]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_083941__759.json86.6667missingmissingmissing
5102Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_083944__15540.002122.720742[107, 35]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_083944__155.json86.6667missingmissingmissing
5103Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_083806__85740.0096524.68242[170, 265]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_083806__857.json86.6667missingmissingmissing
5104Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_083818__84550.0070712.00193[170, 179]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_083818__845.json100.0missingmissingmissing
5105Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_083839__46340.0077320.78672[170, 201]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_083839__463.json86.6667missingmissingmissing
5106Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_083849__44140.0059610.72652[170, 142]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_083849__441.json86.6667missingmissingmissing
5107Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_083915__33540.0108225.62012[170, 304]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_083915__335.json86.6667missingmissingmissing
5108Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_085035__70250.0084916.42973[330, 173]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_085035__702.json100.0missingmissingmissing
5109Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_085056__35150.0129921.12763[330, 323]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_085056__351.json100.0missingmissingmissing
5110Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_085116__17650.0129619.82883[330, 322]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_085116__176.json100.0missingmissingmissing
5111Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapCoTTask1SHOTfalsefalse520240201_085138__49800.0126621.25320[330, 312]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_085138__498.json0.0missingmissingmissing
5112Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_085159__99450.0096321.18593[330, 211]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_085159__994.json100.0missingmissingmissing
5113Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_084654__48150.0134947.43723[329, 340]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_084654__481.json100.0missingmissingmissing
5114Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_084726__10650.0154732.17073[329, 406]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_084726__106.json100.0missingmissingmissing
5115Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapTask1SHOTfalsefalse520240201_084743__35800.0105217.29130[329, 241]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_084743__358.json0.0missingmissingmissing
5116Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_084813__58450.0114829.14983[329, 273]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_084813__584.json100.0missingmissingmissing
5117Apple-MacBook-Pro-M1clean_columngpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_084843__41650.0162230.59813[329, 431]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_084843__416.json100.0missingmissingmissing
5118Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewAsIs1SHOTfalsefalse520231213_202208__57100.0055217.57890[69, 161]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_202208__571.json0.0missingmissingmissing
5119Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewAsIs1SHOTfalsefalse520231225_190949__89400.005712.14480[69, 167]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_190949__894.json0.0missingmissingmissing
5120Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewAsIs1SHOTfalsefalse520231225_190958__54900.007149.724340[69, 215]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_190958__549.json0.0missingmissingmissing
5121Apple-MacBook-Pro-M1clean_columngpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_193251__10500.012.87860[69, 163]0.10.0-DEV31.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_193251__105.json0.00.1missing0.9
5122Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewInJulia1SHOTtruetrue520231213_202150__80640.008424.89152[72, 256]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_202150__806.json86.6667missingmissingmissing
5123Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewInJulia1SHOTtruetrue520231225_190908__76430.0094513.60322[72, 291]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_190908__764.json81.6667missingmissingmissing
5124Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewInJulia1SHOTtruetrue520231225_190936__34140.0073228.27942[72, 220]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_190936__341.json86.6667missingmissingmissing
5125Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewInJulia1SHOTtruetrue520231227_194439__47240.0068114.14682[72, 203]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_194439__472.json86.6667missingmissingmissing
5126Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewInJulia1SHOTtruetrue520231227_194450__16050.0067811.50723[72, 202]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_194450__160.json100.0missingmissingmissing
5127Apple-MacBook-Pro-M1clean_columngpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_193238__67540.018.91362[72, 245]0.10.0-DEV31.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_193238__675.json86.66670.1missing0.9
5128Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_202125__84730.003959.428672[107, 96]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_202125__847.json81.6667missingmissingmissing
5129Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_190850__69230.002062.594962[107, 33]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_190850__692.json81.6667missingmissingmissing
5130Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_190854__25940.003564.202342[107, 83]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_190854__259.json86.6667missingmissingmissing
5131Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_194409__76100.0023.470480[107, 31]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_194409__761.json50.0missingmissingmissing
5132Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_194425__21640.0036815.20472[107, 87]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_194425__216.json86.6667missingmissingmissing
5133Apple-MacBook-Pro-M1clean_columngpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_193219__72330.05.095142[107, 67]0.10.0-DEV31.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_193219__723.json81.66670.1missing0.9
5134Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_202116__62340.0049110.22022[170, 107]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202116__623.json86.6667missingmissingmissing
5135Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_190828__53140.0084214.97532[170, 224]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190828__531.json86.6667missingmissingmissing
5136Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_190847__74340.0067419.78972[170, 168]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_190847__743.json86.6667missingmissingmissing
5137Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_194348__35940.0082417.46782[170, 218]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194348__359.json86.6667missingmissingmissing
5138Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_194406__41840.0086917.89752[170, 233]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194406__418.json86.6667missingmissingmissing
5139Apple-MacBook-Pro-M1clean_columngpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193214__49940.014.65412[170, 204]0.10.0-DEV31.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193214__499.json86.66670.1missing0.9
5140Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_202302__25150.0110120.75553[330, 257]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202302__251.json100.0missingmissingmissing
5141Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_191030__59450.008111.06773[330, 160]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191030__594.json100.0missingmissingmissing
5142Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_191057__50150.0235826.40013[330, 676]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191057__501.json100.0missingmissingmissing
5143Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_194600__30650.0119736.20923[330, 289]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194600__306.json100.0missingmissingmissing
5144Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_194625__65050.011725.27163[330, 280]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194625__650.json100.0missingmissingmissing
5145Apple-MacBook-Pro-M1clean_columngpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_193332__34450.019.30213[330, 290]0.10.0-DEV31.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193332__344.json100.00.1missing0.9
5146Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_202241__99050.0149333.44343[329, 388]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_202241__990.json100.0missingmissingmissing
5147Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_191009__35950.0115110.4393[329, 274]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_191009__359.json100.0missingmissingmissing
5148Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_191019__78050.0106410.273[329, 245]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_191019__780.json100.0missingmissingmissing
5149Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_194502__58050.0092311.00563[329, 198]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_194502__580.json100.0missingmissingmissing
5150Apple-MacBook-Pro-M1clean_columngpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_194524__34050.0124422.2673[329, 305]0.10.0-DEV31.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_194524__340.json100.0missingmissingmissing
5151Apple-MacBook-Pro-M1clean_columngpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_193312__49350.021.42223[329, 278]0.10.0-DEV31.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_193312__493.json100.00.1missing0.9
5152Apple-MacBook-Pro-M1clean_columnllama2AsIs1SHOTfalsefalse520231214_002702__85200.06.577320[62, 198]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__AsIs__1SHOT__20231214_002702__852.json0.0missingmissingmissing
5153Apple-MacBook-Pro-M1clean_columnllama2AsIs1SHOTfalsefalse520231225_024650__86800.07.131120[62, 215]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__AsIs__1SHOT__20231225_024650__868.json0.0missing{\n "num_gpu": 99\n}missing
5154Apple-MacBook-Pro-M1clean_columnllama2AsIs1SHOTfalsefalse520231225_024658__21400.08.0120[1, 254]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__AsIs__1SHOT__20231225_024658__214.json0.0missing{\n "num_gpu": 99\n}missing
5155Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTfalsefalse520231214_002656__19300.013.91540[79, 412]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231214_002656__193.json0.0missingmissingmissing
5156Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTfalsefalse520231225_024631__43700.011.6770[79, 347]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231225_024631__437.json0.0missing{\n "num_gpu": 99\n}missing
5157Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTfalsefalse520231225_024643__86000.011.65120[1, 362]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231225_024643__860.json0.0missing{\n "num_gpu": 99\n}missing
5158Apple-MacBook-Pro-M1clean_columnllama2InJulia1SHOTtruetrue520231226_232107__86800.013.06930[79, 393]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__InJulia__1SHOT__20231226_232107__868.json50.0missing{\n "num_gpu": 99\n}missing
5159Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTfalsefalse520231214_002642__29500.06.95090[108, 195]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_002642__295.json0.0missingmissingmissing
5160Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTtruetrue520231225_024613__19300.09.841250[108, 282]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_024613__193.json50.0missing{\n "num_gpu": 99\n}missing
5161Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTfalsefalse520231225_024619__55700.05.857330[1, 184]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_024619__557.json0.0missing{\n "num_gpu": 99\n}missing
5162Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertAsk1SHOTfalsefalse520231226_232054__49700.05.004780[108, 137]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_232054__497.json0.0missing{\n "num_gpu": 99\n}missing
5163Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTtruefalse520231214_002635__47800.014.97560[184, 404]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002635__478.json25.0missingmissingmissing
5164Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_024550__95000.022.36120[202, 461]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024550__950.json0.0missing{\n "num_gpu": 99\n}missing
5165Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_024603__76700.013.44830[1, 399]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024603__767.json0.0missing{\n "num_gpu": 99\n}missing
5166Apple-MacBook-Pro-M1clean_columnllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_232049__35600.013.4330[202, 223]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232049__356.json0.0missing{\n "num_gpu": 99\n}missing
5167Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231214_002740__23300.018.68910[11, 508]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_002740__233.json50.0missingmissingmissing
5168Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231225_024742__66600.010.08790[11, 281]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024742__666.json50.0missing{\n "num_gpu": 99\n}missing
5169Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231225_024755__41000.012.05840[1, 339]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024755__410.json50.0missing{\n "num_gpu": 99\n}missing
5170Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapCoTTask1SHOTtruetrue520231226_232135__70500.012.40740[11, 349]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232135__705.json50.0missing{\n "num_gpu": 99\n}missing
5171Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTfalsefalse520231214_002721__84000.018.73360[379, 426]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_002721__840.json0.0missingmissingmissing
5172Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTtruetrue520231225_024715__31000.017.17370[379, 385]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_024715__310.json50.0missing{\n "num_gpu": 99\n}missing
5173Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTfalsefalse520231225_024732__89800.017.30480[1, 477]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_024732__898.json0.0missing{\n "num_gpu": 99\n}missing
5174Apple-MacBook-Pro-M1clean_columnllama2JuliaRecapTask1SHOTfalsefalse520231226_232123__40900.015.68680[379, 351]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_232123__409.json0.0missing{\n "num_gpu": 99\n}missing
5175Apple-MacBook-Pro-M1clean_columnmagicoderAsIs1SHOTfalsefalse520231214_003426__97400.07.678880[62, 232]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__AsIs__1SHOT__20231214_003426__974.json0.0missingmissingmissing
5176Apple-MacBook-Pro-M1clean_columnmagicoderAsIs1SHOTfalsefalse520231225_030246__99300.05.119910[76, 162]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__AsIs__1SHOT__20231225_030246__993.json0.0missing{\n "num_gpu": 99\n}missing
5177Apple-MacBook-Pro-M1clean_columnmagicoderAsIs1SHOTfalsefalse520231225_030249__44000.03.253940[76, 98]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__AsIs__1SHOT__20231225_030249__440.json0.0missing{\n "num_gpu": 99\n}missing
5178Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231214_003418__32300.014.20080[79, 420]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231214_003418__323.json50.0missingmissingmissing
5179Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231225_030235__82330.05.595432[79, 178]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231225_030235__823.json81.6667missing{\n "num_gpu": 99\n}missing
5180Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231225_030241__33950.05.707663[79, 182]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231225_030241__339.json100.0missing{\n "num_gpu": 99\n}missing
5181Apple-MacBook-Pro-M1clean_columnmagicoderInJulia1SHOTtruetrue520231226_232758__81040.03.518012[79, 107]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__InJulia__1SHOT__20231226_232758__810.json86.6667missing{\n "num_gpu": 99\n}missing
5182Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231214_003404__36200.05.899810[108, 162]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_003404__362.json50.0missingmissingmissing
5183Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231225_030225__25900.07.822150[118, 247]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_030225__259.json50.0missing{\n "num_gpu": 99\n}missing
5184Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231225_030230__23950.04.308583[118, 129]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_030230__239.json100.0missing{\n "num_gpu": 99\n}missing
5185Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertAsk1SHOTtruetrue520231226_232755__84340.06.07982[118, 189]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_232755__843.json86.6667missing{\n "num_gpu": 99\n}missing
5186Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_003358__63700.019.0870[184, 518]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003358__637.json0.0missingmissingmissing
5187Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_030210__42100.010.25150[194, 112]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030210__421.json0.0missing{\n "num_gpu": 99\n}missing
5188Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTtruefalse520231225_030217__25200.07.129680[194, 209]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030217__252.json25.0missing{\n "num_gpu": 99\n}missing
5189Apple-MacBook-Pro-M1clean_columnmagicoderJuliaExpertCoTTask1SHOTtruetrue520231226_232748__34500.012.29682[194, 189]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232748__345.json66.6667missing{\n "num_gpu": 99\n}missing
5190Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_003449__64000.012.54990[11, 347]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003449__640.json50.0missingmissingmissing
5191Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_030313__58500.08.6110[382, 228]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030313__585.json50.0missing{\n "num_gpu": 99\n}missing
5192Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_030322__60050.08.503293[382, 225]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030322__600.json100.0missing{\n "num_gpu": 99\n}missing
5193Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_232813__89850.07.716413[382, 200]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232813__898.json100.0missing{\n "num_gpu": 99\n}missing
5194Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231214_003437__89400.010.55050[379, 205]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_003437__894.json50.0missingmissingmissing
5195Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231225_030258__16250.08.823983[379, 234]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_030258__162.json100.0missing{\n "num_gpu": 99\n}missing
5196Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231225_030305__49000.06.406020[379, 157]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_030305__490.json50.0missing{\n "num_gpu": 99\n}missing
5197Apple-MacBook-Pro-M1clean_columnmagicoderJuliaRecapTask1SHOTtruetrue520231226_232805__63950.07.220573[379, 184]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_232805__639.json100.0missing{\n "num_gpu": 99\n}missing
5198Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180147__26600.020.60720[79, 401]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180147__266.json50.0missing{\n "num_gpu": 99\n}missing
5199Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180150__79100.03.19110[79, 54]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180150__791.json50.0missing{\n "num_gpu": 99\n}missing
5200Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180158__58950.07.643673[79, 144]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180158__589.json100.0missing{\n "num_gpu": 99\n}missing
5201Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180117__53000.04.651450[118, 80]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180117__530.json50.0missing{\n "num_gpu": 99\n}missing
5202Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180120__70050.03.213233[118, 51]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180120__700.json100.0missing{\n "num_gpu": 99\n}missing
5203Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180126__70900.06.185652[118, 111]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180126__709.json66.6667missing{\n "num_gpu": 99\n}missing
5204Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180100__25140.07.701543[194, 131]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180100__251.json95.0missing{\n "num_gpu": 99\n}missing
5205Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180109__25050.09.562833[194, 168]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180109__250.json100.0missing{\n "num_gpu": 99\n}missing
5206Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_180112__47600.02.947950[194, 36]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180112__476.json0.0missing{\n "num_gpu": 99\n}missing
5207Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180241__34330.014.3372[382, 241]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180241__343.json81.6667missing{\n "num_gpu": 99\n}missing
5208Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180251__78440.09.532732[382, 148]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180251__784.json86.6667missing{\n "num_gpu": 99\n}missing
5209Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180258__76050.07.231193[382, 103]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180258__760.json100.0missing{\n "num_gpu": 99\n}missing
5210Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180208__24000.010.15710[379, 160]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180208__240.json50.0missing{\n "num_gpu": 99\n}missing
5211Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180219__84730.010.71712[379, 171]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180219__847.json81.6667missing{\n "num_gpu": 99\n}missing
5212Apple-MacBook-Pro-M1clean_columnmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180227__14950.07.998933[379, 118]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180227__149.json100.0missing{\n "num_gpu": 99\n}missing
5213Apple-MacBook-Pro-M1clean_columnmistral-mediumAsIs1SHOTfalsefalse520231213_202613__17900.0016802726.95090[74, 183]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__AsIs__1SHOT__20231213_202613__179.json0.0missingmissingmissing
5214Apple-MacBook-Pro-M1clean_columnmistral-mediumAsIs1SHOTfalsefalse520231225_191308__86200.003104118.029280[74, 359]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__AsIs__1SHOT__20231225_191308__862.json0.0missingmissingmissing
5215Apple-MacBook-Pro-M1clean_columnmistral-mediumAsIs1SHOTfalsefalse520231225_191324__19900.0025297216.51160[74, 288]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__AsIs__1SHOT__20231225_191324__199.json0.0missingmissingmissing
5216Apple-MacBook-Pro-M1clean_columnmistral-medium--optimAsIs1SHOTfalsefalse520231215_193427__46800.03.451750[74, 155]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__AsIs__1SHOT__20231215_193427__468.json0.00.9missing0.3
5217Apple-MacBook-Pro-M1clean_columnmistral-mediumInJulia1SHOTtruetrue520231213_202546__64650.0026187243.40653[77, 298]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__InJulia__1SHOT__20231213_202546__646.json100.0missingmissingmissing
5218Apple-MacBook-Pro-M1clean_columnmistral-mediumInJulia1SHOTtruetrue520231225_191250__74750.00166418.021823[77, 180]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__InJulia__1SHOT__20231225_191250__747.json100.0missingmissingmissing
5219Apple-MacBook-Pro-M1clean_columnmistral-mediumInJulia1SHOTtruetrue520231225_191300__62300.002537829.707543[77, 288]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__InJulia__1SHOT__20231225_191300__623.json75.0missingmissingmissing
5220Apple-MacBook-Pro-M1clean_columnmistral-mediumInJulia1SHOTtruetrue520231227_194828__42750.001947254.79053[77, 215]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__InJulia__1SHOT__20231227_194828__427.json100.0missingmissingmissing
5221Apple-MacBook-Pro-M1clean_columnmistral-mediumInJulia1SHOTtruetrue520231227_194840__11250.0020119711.68923[77, 223]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__InJulia__1SHOT__20231227_194840__112.json100.0missingmissingmissing
5222Apple-MacBook-Pro-M1clean_columnmistral-medium--optimInJulia1SHOTtruetrue520231215_193423__96750.04.073023[77, 183]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__InJulia__1SHOT__20231215_193423__967.json100.00.9missing0.3
5223Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_202502__92150.0020363732.1363[116, 213]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_202502__921.json100.0missingmissingmissing
5224Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_191238__24550.002020194.763223[116, 211]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_191238__245.json100.0missingmissingmissing
5225Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_191242__95550.001421533.220113[116, 137]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_191242__955.json100.0missingmissingmissing
5226Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_194820__12950.00120312.557653[116, 110]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_194820__129.json100.0missingmissingmissing
5227Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_194823__69450.001381083.123433[116, 132]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_194823__694.json100.0missingmissingmissing
5228Apple-MacBook-Pro-M1clean_columnmistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_193419__10650.04.55983[116, 125]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_193419__106.json100.00.9missing0.3
5229Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_202430__45100.0033013646.45890[192, 344]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202430__451.json50.0missingmissingmissing
5230Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_191227__17050.002427645.748223[192, 236]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191227__170.json100.0missingmissingmissing
5231Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_191234__24650.002799786.343433[192, 282]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191234__246.json100.0missingmissingmissing
5232Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_194803__20350.0025894420.16513[192, 256]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194803__203.json100.0missingmissingmissing
5233Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_194817__41550.0033175414.33253[192, 346]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194817__415.json100.0missingmissingmissing
5234Apple-MacBook-Pro-M1clean_columnmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193415__61950.06.542963[192, 290]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193415__619.json100.00.9missing0.3
5235Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231213_202712__69900.0018889317.54370[379, 107]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202712__699.json0.0missingmissingmissing
5236Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_191348__84650.004146048.842423[379, 386]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191348__846.json100.0missingmissingmissing
5237Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231225_191408__19200.0045424520.58120[379, 435]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191408__192.json0.0missingmissingmissing
5238Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231227_194857__34200.002495684.271660[379, 182]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194857__342.json0.0missingmissingmissing
5239Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_194907__14350.004485829.767253[379, 428]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194907__143.json100.0missingmissingmissing
5240Apple-MacBook-Pro-M1clean_columnmistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_193440__48550.06.513343[379, 285]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193440__485.json100.00.9missing0.3
5241Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapTask1SHOTtruetrue520231213_202655__83800.0033208542.16280[376, 285]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_202655__838.json50.0missingmissingmissing
5242Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapTask1SHOTtruetrue520231225_191333__22950.003959968.400533[376, 364]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_191333__229.json100.0missingmissingmissing
5243Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapTask1SHOTtruetrue520231225_191339__50400.00311866.043240[376, 260]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_191339__504.json50.0missingmissingmissing
5244Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapTask1SHOTtruetrue520231227_194847__84550.003401756.798173[376, 295]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_194847__845.json100.0missingmissingmissing
5245Apple-MacBook-Pro-M1clean_columnmistral-mediumJuliaRecapTask1SHOTtruetrue520231227_194853__15350.003078155.876273[376, 255]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_194853__153.json100.0missingmissingmissing
5246Apple-MacBook-Pro-M1clean_columnmistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_193434__70550.06.926363[376, 306]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_193434__705.json100.00.9missing0.3
5247Apple-MacBook-Pro-M1clean_columnmistral-smallAsIs1SHOTfalsefalse520231213_202337__49500.0002994311.909870[73, 130]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__AsIs__1SHOT__20231213_202337__495.json0.0missingmissingmissing
5248Apple-MacBook-Pro-M1clean_columnmistral-smallAsIs1SHOTfalsefalse520231225_191158__41500.0003634512.370260[73, 163]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__AsIs__1SHOT__20231225_191158__415.json0.0missingmissingmissing
5249Apple-MacBook-Pro-M1clean_columnmistral-smallAsIs1SHOTfalsefalse520231225_191200__88000.0002936111.87240[73, 127]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__AsIs__1SHOT__20231225_191200__880.json0.0missingmissingmissing
5250Apple-MacBook-Pro-M1clean_columnmistral-small--optimAsIs1SHOTfalsefalse520231215_193357__66000.03.483690[73, 257]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__AsIs__1SHOT__20231215_193357__660.json0.00.9missing0.3
5251Apple-MacBook-Pro-M1clean_columnmistral-smallInJulia1SHOTtruetrue520231213_202335__27350.0005147723.34723[76, 240]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__InJulia__1SHOT__20231213_202335__273.json100.0missingmissingmissing
5252Apple-MacBook-Pro-M1clean_columnmistral-smallInJulia1SHOTtruetrue520231225_191153__96450.0003906122.530733[76, 176]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__InJulia__1SHOT__20231225_191153__964.json100.0missingmissingmissing
5253Apple-MacBook-Pro-M1clean_columnmistral-smallInJulia1SHOTtruetrue520231225_191156__12750.0003653922.303713[76, 163]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__InJulia__1SHOT__20231225_191156__127.json100.0missingmissingmissing
5254Apple-MacBook-Pro-M1clean_columnmistral-smallInJulia1SHOTtruetrue520231227_194716__90050.0005108923.307833[76, 238]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__InJulia__1SHOT__20231227_194716__900.json100.0missingmissingmissing
5255Apple-MacBook-Pro-M1clean_columnmistral-smallInJulia1SHOTtruetrue520231227_194719__40650.0003770322.489213[76, 169]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__InJulia__1SHOT__20231227_194719__406.json100.0missingmissingmissing
5256Apple-MacBook-Pro-M1clean_columnmistral-small--optimInJulia1SHOTtruetrue520231215_193354__40950.02.435043[76, 183]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__InJulia__1SHOT__20231215_193354__409.json100.00.9missing0.3
5257Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertAsk1SHOTtruefalse520231213_202332__34600.0004462392.716360[117, 191]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_202332__346.json25.0missingmissingmissing
5258Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_191150__58750.0003841592.329763[117, 159]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_191150__587.json100.0missingmissingmissing
5259Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_191151__81640.0001532990.7351373[117, 40]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_191151__816.json95.0missingmissingmissing
5260Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertAsk1SHOTtruetrue520231227_194711__51740.0001532997.042693[117, 40]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_194711__517.json95.0missingmissingmissing
5261Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertAsk1SHOTtruetrue520231227_194713__51300.0003104391.891270[117, 121]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_194713__513.json50.0missingmissingmissing
5262Apple-MacBook-Pro-M1clean_columnmistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_193351__61740.00.7231793[117, 40]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_193351__617.json95.00.9missing0.3
5263Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_202329__27450.0006913514.014173[193, 292]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202329__274.json100.0missingmissingmissing
5264Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_191142__48200.0007340314.326150[193, 314]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191142__482.json50.0missingmissingmissing
5265Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_191147__85450.0007631314.618783[193, 329]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191147__854.json100.0missingmissingmissing
5266Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_194659__92300.0006700113.989410[193, 281]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194659__923.json50.0missingmissingmissing
5267Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_194704__31750.0008155114.862363[193, 356]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194704__317.json100.0missingmissingmissing
5268Apple-MacBook-Pro-M1clean_columnmistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193350__46250.04.209573[193, 310]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193350__462.json100.00.9missing0.3
5269Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_202343__68150.0006280412.809993[383, 196]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202343__681.json100.0missingmissingmissing
5270Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_191217__51050.0007929414.003683[383, 281]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191217__510.json100.0missingmissingmissing
5271Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_191221__29650.0008220414.068693[383, 296]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191221__296.json100.0missingmissingmissing
5272Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_194740__97050.0006765413.143283[383, 221]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194740__970.json100.0missingmissingmissing
5273Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_194743__59200.0006823613.215230[383, 224]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194743__592.json50.0missingmissingmissing
5274Apple-MacBook-Pro-M1clean_columnmistral-small--optimJuliaRecapCoTTask1SHOTtruetrue520231215_193408__32350.06.947913[383, 518]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193408__323.json100.00.9missing0.3
5275Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapTask1SHOTtruetrue520231213_202340__48250.0007179273.368013[381, 243]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_202340__482.json100.0missingmissingmissing
5276Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapTask1SHOTtruetrue520231225_191206__15100.001125336.320330[381, 453]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_191206__151.json50.0missingmissingmissing
5277Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapTask1SHOTtruetrue520231225_191213__66550.001193236.667793[381, 488]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_191213__665.json100.0missingmissingmissing
5278Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapTask1SHOTtruetrue520231227_194729__71150.00078000710.39273[381, 275]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_194729__711.json100.0missingmissingmissing
5279Apple-MacBook-Pro-M1clean_columnmistral-smallJuliaRecapTask1SHOTtruetrue520231227_194736__58000.001259197.134740[381, 522]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_194736__580.json50.0missingmissingmissing
5280Apple-MacBook-Pro-M1clean_columnmistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_193401__22650.03.858643[381, 287]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_193401__226.json100.00.9missing0.3
5281Apple-MacBook-Pro-M1clean_columnmistral-tinyAsIs1SHOTfalsefalse520231213_202316__56900.0001130513.250760[73, 227]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__AsIs__1SHOT__20231213_202316__569.json0.0missingmissingmissing
5282Apple-MacBook-Pro-M1clean_columnmistral-tinyAsIs1SHOTfalsefalse520231225_191120__71300.0001243763.053070[73, 252]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__AsIs__1SHOT__20231225_191120__713.json0.0missingmissingmissing
5283Apple-MacBook-Pro-M1clean_columnmistral-tinyAsIs1SHOTfalsefalse520231225_191122__75900.0001298122.363630[73, 264]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__AsIs__1SHOT__20231225_191122__759.json0.0missingmissingmissing
5284Apple-MacBook-Pro-M1clean_columnmistral-tiny--optimAsIs1SHOTfalsefalse520231215_193341__36100.02.441490[73, 293]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__AsIs__1SHOT__20231215_193341__361.json0.00.9missing0.3
5285Apple-MacBook-Pro-M1clean_columnmistral-tinyInJulia1SHOTtruetrue520231213_202313__12358.9462e-53.28433[76, 174]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__InJulia__1SHOT__20231213_202313__123.json100.0missingmissingmissing
5286Apple-MacBook-Pro-M1clean_columnmistral-tinyInJulia1SHOTtruetrue520231225_191113__30450.0001116592.060613[76, 223]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__InJulia__1SHOT__20231225_191113__304.json100.0missingmissingmissing
5287Apple-MacBook-Pro-M1clean_columnmistral-tinyInJulia1SHOTtruetrue520231225_191117__77100.0001383863.437860[76, 282]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__InJulia__1SHOT__20231225_191117__771.json50.0missingmissingmissing
5288Apple-MacBook-Pro-M1clean_columnmistral-tinyInJulia1SHOTtruetrue520231227_194642__36259.5351e-51.694663[76, 187]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__InJulia__1SHOT__20231227_194642__362.json100.0missingmissingmissing
5289Apple-MacBook-Pro-M1clean_columnmistral-tinyInJulia1SHOTtruetrue520231227_194645__41950.0001383862.57753[76, 282]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__InJulia__1SHOT__20231227_194645__419.json100.0missingmissingmissing
5290Apple-MacBook-Pro-M1clean_columnmistral-tiny--optimInJulia1SHOTtruetrue520231215_193338__17750.01.321623[76, 155]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__InJulia__1SHOT__20231215_193338__177.json100.00.9missing0.3
5291Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_202310__65153.9483e-51.037253[117, 51]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_202310__651.json100.0missingmissingmissing
5292Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_191109__26943.5406e-50.5349353[117, 42]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_191109__269.json95.0missingmissingmissing
5293Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_191111__57600.0001173992.163593[117, 223]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_191111__576.json75.0missingmissingmissing
5294Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_194639__38057.8894e-51.424763[117, 138]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_194639__380.json100.0missingmissingmissing
5295Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_194640__45455.5338e-50.9148263[117, 86]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_194640__454.json100.0missingmissingmissing
5296Apple-MacBook-Pro-M1clean_columnmistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_193337__21250.00.5429473[117, 51]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_193337__212.json100.00.9missing0.3
5297Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231213_202309__88900.000162926.584910[193, 300]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202309__889.json50.0missingmissingmissing
5298Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_191106__41400.000149338.964110[193, 270]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191106__414.json50.0missingmissingmissing
5299Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_191108__63650.0001293982.107173[193, 226]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191108__636.json100.0missingmissingmissing
5300Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231227_194635__27900.0001710749.397970[193, 318]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194635__279.json25.0missingmissingmissing
5301Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_194638__19750.0001701682.805153[193, 316]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194638__197.json100.0missingmissingmissing
5302Apple-MacBook-Pro-M1clean_columnmistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193336__96900.04.272850[193, 258]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193336__969.json50.00.9missing0.3
5303Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_202325__76550.0001999394.147323[383, 323]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202325__765.json100.0missingmissingmissing
5304Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_191134__46850.0001908793.433173[383, 303]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191134__468.json100.0missingmissingmissing
5305Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231225_191138__16300.0002026574.148120[383, 329]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191138__163.json0.0missingmissingmissing
5306Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_194651__29400.0001297241.611920[383, 168]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194651__294.json50.0missingmissingmissing
5307Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_194655__13900.0002171533.327640[383, 361]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194655__139.json50.0missingmissingmissing
5308Apple-MacBook-Pro-M1clean_columnmistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_193346__65100.02.745150[383, 316]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193346__651.json50.00.9missing0.3
5309Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapTask1SHOTtruetrue520231213_202321__25850.0001819924.203143[381, 284]0.10.0-DEV31.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_202321__258.json100.0missingmissingmissing
5310Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapTask1SHOTtruetrue520231225_191126__74350.0001964883.815323[381, 316]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_191126__743.json100.0missingmissingmissing
5311Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapTask1SHOTtruetrue520231225_191130__27700.0002091724.252523[381, 344]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_191130__277.json75.0missingmissingmissing
5312Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapTask1SHOTtruetrue520231227_194648__84050.0002055483.104843[381, 336]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_194648__840.json100.0missingmissingmissing
5313Apple-MacBook-Pro-M1clean_columnmistral-tinyJuliaRecapTask1SHOTtruetrue520231227_194650__99550.0001403161.793483[381, 192]0.10.0-DEV31.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_194650__995.json100.0missingmissingmissing
5314Apple-MacBook-Pro-M1clean_columnmistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_193343__51050.02.387473[381, 276]0.10.0-DEV31.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_193343__510.json100.00.9missing0.3
5315Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_230702__13400.06.494010[62, 196]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_230702__134.json0.0missingmissingmissing
5316Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_230707__95200.05.043680[1, 163]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_230707__952.json0.0missingmissingmissing
5317Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_230712__61600.05.211660[1, 168]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_230712__616.json0.0missingmissingmissing
5318Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_230638__59700.013.20830[79, 393]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_230638__597.json0.0missingmissingmissing
5319Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231219_230644__53100.05.697740[1, 183]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_230644__531.json50.0missingmissingmissing
5320Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_230656__80900.011.9640[1, 373]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_230656__809.json0.0missingmissingmissing
5321Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231226_233723__56700.02.746450[75, 59]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231226_233723__567.json50.0missing{\n "num_gpu": 99\n}missing
5322Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230615__68000.09.267270[108, 266]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230615__680.json50.0missingmissingmissing
5323Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_230620__23800.04.959880[1, 158]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230620__238.json0.0missingmissingmissing
5324Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230625__19900.04.966740[1, 158]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230625__199.json50.0missingmissingmissing
5325Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231226_233720__55700.08.83990[116, 213]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233720__557.json0.0missing{\n "num_gpu": 99\n}missing
5326Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_230540__99800.014.58920[184, 395]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230540__998.json25.0missingmissingmissing
5327Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_230556__17200.015.60040[1, 460]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230556__172.json50.0missingmissingmissing
5328Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230605__99400.09.688260[1, 294]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230605__994.json0.0missingmissingmissing
5329Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_233711__87400.09.216380[192, 75]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233711__874.json25.0missing{\n "num_gpu": 99\n}missing
5330Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230818__84700.020.00980[11, 542]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230818__847.json50.0missingmissingmissing
5331Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230834__67600.015.88560[1, 442]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230834__676.json50.0missingmissingmissing
5332Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230851__71300.016.57330[1, 460]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230851__713.json50.0missingmissingmissing
5333Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233756__16600.018.80730[383, 421]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233756__166.json50.0missing{\n "num_gpu": 99\n}missing
5334Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_230730__64400.017.50380[379, 395]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230730__644.json50.0missingmissingmissing
5335Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_230747__47800.017.18730[1, 476]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230747__478.json50.0missingmissingmissing
5336Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_230758__56800.011.01290[1, 313]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230758__568.json50.0missingmissingmissing
5337Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233737__24600.014.57610[381, 317]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233737__246.json50.0missing{\n "num_gpu": 99\n}missing
5338Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231840__22750.07.037983[74, 219]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231840__227.json100.0missing{\n "num_gpu": 99\n}missing
5339Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_231847__48400.07.160180[74, 223]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231847__484.json25.0missing{\n "num_gpu": 99\n}missing
5340Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231854__19500.06.882323[74, 214]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231854__195.json75.0missing{\n "num_gpu": 99\n}missing
5341Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231903__88700.08.850040[74, 278]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231903__887.json50.0missing{\n "num_gpu": 99\n}missing
5342Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_231914__77600.011.40970[74, 361]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_231914__776.json50.0missing{\n "num_gpu": 99\n}missing
5343Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231825__82850.02.134243[115, 51]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231825__828.json100.0missing{\n "num_gpu": 99\n}missing
5344Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231827__42650.01.933833[115, 45]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231827__426.json100.0missing{\n "num_gpu": 99\n}missing
5345Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231829__50950.01.953763[115, 45]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231829__509.json100.0missing{\n "num_gpu": 99\n}missing
5346Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231831__45150.02.026853[115, 48]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231831__451.json100.0missing{\n "num_gpu": 99\n}missing
5347Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_231833__72400.01.902110[115, 44]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_231833__724.json50.0missing{\n "num_gpu": 99\n}missing
5348Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_231750__98200.012.28110[191, 344]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231750__982.json0.0missing{\n "num_gpu": 99\n}missing
5349Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231759__17000.08.898323[191, 262]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231759__170.json75.0missing{\n "num_gpu": 99\n}missing
5350Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231806__35550.07.667643[191, 222]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231806__355.json100.0missing{\n "num_gpu": 99\n}missing
5351Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231810__85250.03.729643[191, 94]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231810__852.json100.0missing{\n "num_gpu": 99\n}missing
5352Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_231823__21800.012.35733[191, 372]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_231823__218.json75.0missing{\n "num_gpu": 99\n}missing
5353Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232017__17500.012.75130[382, 348]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232017__175.json50.0missing{\n "num_gpu": 99\n}missing
5354Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232030__87750.012.93833[382, 353]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232030__877.json100.0missing{\n "num_gpu": 99\n}missing
5355Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232041__47340.010.13453[382, 267]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232041__473.json95.0missing{\n "num_gpu": 99\n}missing
5356Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232051__46450.010.03723[382, 264]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232051__464.json100.0missing{\n "num_gpu": 99\n}missing
5357Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_232102__11000.010.90770[382, 291]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232102__110.json50.0missing{\n "num_gpu": 99\n}missing
5358Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231925__77900.010.20350[380, 269]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231925__779.json50.0missing{\n "num_gpu": 99\n}missing
5359Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231935__60050.010.18843[380, 269]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231935__600.json100.0missing{\n "num_gpu": 99\n}missing
5360Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231946__28150.011.31653[380, 304]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231946__281.json100.0missing{\n "num_gpu": 99\n}missing
5361Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_231954__67850.07.160173[380, 174]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_231954__678.json100.0missing{\n "num_gpu": 99\n}missing
5362Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_232005__31650.010.88383[380, 291]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232005__316.json100.0missing{\n "num_gpu": 99\n}missing
5363Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_232215__52400.08.232840[74, 202]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232215__524.json0.0missing{\n "num_gpu": 99\n}missing
5364Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_232226__80950.011.64673[74, 290]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232226__809.json100.0missing{\n "num_gpu": 99\n}missing
5365Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_232235__40900.08.971810[74, 221]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232235__409.json25.0missing{\n "num_gpu": 99\n}missing
5366Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_232246__21900.010.09050[74, 250]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232246__219.json50.0missing{\n "num_gpu": 99\n}missing
5367Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_232255__31950.08.938293[74, 220]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_232255__319.json100.0missing{\n "num_gpu": 99\n}missing
5368Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232146__34850.03.021443[115, 61]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232146__348.json100.0missing{\n "num_gpu": 99\n}missing
5369Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232152__99050.05.622163[115, 129]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232152__990.json100.0missing{\n "num_gpu": 99\n}missing
5370Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_232157__31900.05.58980[115, 128]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232157__319.json0.0missing{\n "num_gpu": 99\n}missing
5371Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232201__36650.03.473113[115, 73]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232201__366.json100.0missing{\n "num_gpu": 99\n}missing
5372Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_232206__23200.05.69870[115, 131]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_232206__232.json50.0missing{\n "num_gpu": 99\n}missing
5373Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232108__42840.06.005592[191, 108]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232108__428.json86.6667missing{\n "num_gpu": 99\n}missing
5374Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232112__94920.04.128433[191, 81]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232112__949.json85.0missing{\n "num_gpu": 99\n}missing
5375Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232122__13000.010.45410[191, 243]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232122__130.json50.0missing{\n "num_gpu": 99\n}missing
5376Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_232130__68200.07.523320[191, 168]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232130__682.json25.0missing{\n "num_gpu": 99\n}missing
5377Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_232143__53900.012.76720[191, 302]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232143__539.json50.0missing{\n "num_gpu": 99\n}missing
5378Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_232412__86900.015.2810[382, 333]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232412__869.json25.0missing{\n "num_gpu": 99\n}missing
5379Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_232427__82400.014.95743[382, 325]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232427__824.json75.0missing{\n "num_gpu": 99\n}missing
5380Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_232442__80900.014.60173[382, 316]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232442__809.json75.0missing{\n "num_gpu": 99\n}missing
5381Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_232455__19200.013.38630[382, 286]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232455__192.json25.0missing{\n "num_gpu": 99\n}missing
5382Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_232511__44620.015.73563[382, 344]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_232511__446.json85.0missing{\n "num_gpu": 99\n}missing
5383Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232303__85100.08.679320[380, 169]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232303__851.json50.0missing{\n "num_gpu": 99\n}missing
5384Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232317__40900.013.4530[380, 288]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232317__409.json50.0missing{\n "num_gpu": 99\n}missing
5385Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232332__39900.015.12230[380, 329]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232332__399.json50.0missing{\n "num_gpu": 99\n}missing
5386Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232348__32900.015.77040[380, 345]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232348__329.json50.0missing{\n "num_gpu": 99\n}missing
5387Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_232357__22250.09.04443[380, 178]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_232357__222.json100.0missing{\n "num_gpu": 99\n}missing
5388Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_121307__26500.016.62720[71, 296]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_121307__265.json0.0missing{\n "num_gpu": 99\n}missing
5389Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_121322__41400.014.99010[71, 270]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_121322__414.json0.0missing{\n "num_gpu": 99\n}missing
5390Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_121236__33100.012.41280[74, 223]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121236__331.json50.0missing{\n "num_gpu": 99\n}missing
5391Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_121250__35250.013.97673[74, 251]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121250__352.json100.0missing{\n "num_gpu": 99\n}missing
5392Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_234006__82350.010.00833[74, 180]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_234006__823.json100.0missing{\n "num_gpu": 99\n}missing
5393Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_121220__35300.03.307620[115, 48]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121220__353.json0.0missing{\n "num_gpu": 99\n}missing
5394Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_121224__74750.03.381963[115, 50]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121224__747.json100.0missing{\n "num_gpu": 99\n}missing
5395Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_233956__46750.03.139463[115, 46]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_233956__467.json100.0missing{\n "num_gpu": 99\n}missing
5396Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_121211__30000.015.15510[191, 261]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121211__300.json50.0missing{\n "num_gpu": 99\n}missing
5397Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_121217__57050.05.714593[191, 83]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121217__570.json100.0missing{\n "num_gpu": 99\n}missing
5398Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_233953__84600.018.92780[191, 168]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233953__846.json50.0missing{\n "num_gpu": 99\n}missing
5399Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_121417__71250.021.49433[382, 353]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121417__712.json100.0missing{\n "num_gpu": 99\n}missing
5400Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_121438__40940.020.84793[382, 346]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121438__409.json95.0missing{\n "num_gpu": 99\n}missing
5401Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_234046__62450.019.79533[382, 326]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234046__624.json100.0missing{\n "num_gpu": 99\n}missing
5402Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121340__51050.018.30953[380, 296]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121340__510.json100.0missing{\n "num_gpu": 99\n}missing
5403Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121355__81950.014.89833[380, 230]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121355__819.json100.0missing{\n "num_gpu": 99\n}missing
5404Apple-MacBook-Pro-M1clean_columnmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_234026__16950.019.67683[380, 324]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_234026__169.json100.0missing{\n "num_gpu": 99\n}missing
5405Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_111808__91430.026.29352[78, 149]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_111808__914.json81.6667missing{\n "num_gpu": 99\n}missing
5406Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_111839__78450.030.82723[78, 177]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_111839__784.json100.0missing{\n "num_gpu": 99\n}missing
5407Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_111904__48540.024.99153[78, 141]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_111904__485.json95.0missing{\n "num_gpu": 99\n}missing
5408Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_145555__27900.026.88630[78, 152]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_145555__279.json50.0missing{\n "num_gpu": 99\n}missing
5409Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_145617__43440.021.85522[78, 121]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_145617__434.json86.6667missing{\n "num_gpu": 99\n}missing
5410Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_111712__19550.042.20763[117, 241]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_111712__195.json100.0missing{\n "num_gpu": 99\n}missing
5411Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_111733__55400.021.45690[117, 114]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_111733__554.json50.0missing{\n "num_gpu": 99\n}missing
5412Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_111742__35400.08.86380[117, 36]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_111742__354.json0.0missing{\n "num_gpu": 99\n}missing
5413Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_145441__60900.035.46353[117, 199]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_145441__609.json75.0missing{\n "num_gpu": 99\n}missing
5414Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_145528__98150.047.67153[117, 273]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_145528__981.json100.0missing{\n "num_gpu": 99\n}missing
5415Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_111502__89050.039.95993[192, 191]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111502__890.json100.0missing{\n "num_gpu": 99\n}missing
5416Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_111546__60640.044.2022[192, 242]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111546__606.json86.6667missing{\n "num_gpu": 99\n}missing
5417Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_111629__60200.043.03370[192, 235]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_111629__602.json25.0missing{\n "num_gpu": 99\n}missing
5418Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_145329__16440.052.3933[192, 290]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_145329__164.json95.0missing{\n "num_gpu": 99\n}missing
5419Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_145405__83000.035.91530[192, 191]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_145405__830.json0.0missing{\n "num_gpu": 99\n}missing
5420Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_112219__35530.038.55773[391, 170]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112219__355.json90.0missing{\n "num_gpu": 99\n}missing
5421Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_112319__83050.060.18153[391, 298]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112319__830.json100.0missing{\n "num_gpu": 99\n}missing
5422Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_112330__36600.010.92270[391, 4]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112330__366.json0.0missing{\n "num_gpu": 99\n}missing
5423Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_145819__73000.011.05750[391, 4]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145819__730.json0.0missing{\n "num_gpu": 99\n}missing
5424Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_145830__31200.011.20110[391, 5]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_145830__312.json0.0missing{\n "num_gpu": 99\n}missing
5425Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_111948__38110.044.09523[389, 203]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_111948__381.json80.0missing{\n "num_gpu": 99\n}missing
5426Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_112048__18450.059.62113[389, 295]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_112048__184.json100.0missing{\n "num_gpu": 99\n}missing
5427Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_112140__25050.052.14423[389, 251]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_112140__250.json100.0missing{\n "num_gpu": 99\n}missing
5428Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_145710__19650.052.27773[389, 250]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_145710__196.json100.0missing{\n "num_gpu": 99\n}missing
5429Apple-MacBook-Pro-M1clean_columnnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_145808__42600.058.40413[389, 286]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_145808__426.json75.0missing{\n "num_gpu": 99\n}missing
5430Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_231038__61000.05.701540[62, 171]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_231038__610.json0.0missingmissingmissing
5431Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_231043__70400.05.746350[1, 185]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_231043__704.json0.0missingmissingmissing
5432Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_231049__53800.05.932620[1, 191]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_231049__538.json0.0missingmissingmissing
5433Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_231006__46900.011.14760[79, 332]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_231006__469.json0.0missingmissingmissing
5434Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231219_231018__22200.011.59630[1, 362]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_231018__222.json50.0missingmissingmissing
5435Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231219_231032__43600.014.29710[1, 440]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_231032__436.json50.0missingmissingmissing
5436Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231226_233821__43240.07.893722[83, 193]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231226_233821__432.json86.6667missing{\n "num_gpu": 99\n}missing
5437Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230940__69900.05.813750[108, 161]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230940__699.json50.0missingmissingmissing
5438Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230949__17000.08.278260[1, 259]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230949__170.json50.0missingmissingmissing
5439Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230955__21000.06.216790[1, 197]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230955__210.json50.0missingmissingmissing
5440Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_233813__96500.03.242420[124, 67]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233813__965.json50.0missing{\n "num_gpu": 99\n}missing
5441Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_230906__47700.015.7790[184, 428]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230906__477.json50.0missingmissingmissing
5442Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230925__66500.018.18690[1, 530]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230925__665.json0.0missingmissingmissing
5443Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_230934__71400.09.869720[1, 299]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230934__714.json50.0missingmissingmissing
5444Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231226_233810__93100.013.62310[200, 169]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233810__931.json50.0missing{\n "num_gpu": 99\n}missing
5445Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_231158__31300.020.7110[11, 560]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231158__313.json0.0missingmissingmissing
5446Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_231207__35600.09.014090[1, 258]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231207__356.json50.0missingmissingmissing
5447Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_231220__19000.012.7750[1, 360]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231220__190.json0.0missingmissingmissing
5448Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233846__19400.011.85280[391, 245]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233846__194.json50.0missing{\n "num_gpu": 99\n}missing
5449Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_231105__54200.015.59120[379, 344]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_231105__542.json50.0missingmissingmissing
5450Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_231124__94300.018.73820[1, 516]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_231124__943.json0.0missingmissingmissing
5451Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_231138__35600.013.77833[1, 387]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_231138__356.json75.0missingmissingmissing
5452Apple-MacBook-Pro-M1clean_columnopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233834__98700.012.65910[389, 265]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233834__987.json50.0missing{\n "num_gpu": 99\n}missing
5453Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_002817__91500.06.251360[62, 187]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_002817__915.json0.0missingmissingmissing
5454Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_024836__78700.05.382750[78, 167]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_024836__787.json0.0missing{\n "num_gpu": 99\n}missing
5455Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_024842__75300.06.1090[78, 191]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_024842__753.json0.0missing{\n "num_gpu": 99\n}missing
5456Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTtruetrue520231214_002811__93900.010.51970[79, 312]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_002811__939.json50.0missingmissingmissing
5457Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTfalsefalse520231225_024825__63200.01.841220[81, 47]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_024825__632.json0.0missing{\n "num_gpu": 99\n}missing
5458Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_024831__99000.05.559640[81, 173]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_024831__990.json50.0missing{\n "num_gpu": 99\n}missing
5459Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralInJulia1SHOTtruetrue520231226_232153__28050.02.361193[81, 65]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_232153__280.json100.0missing{\n "num_gpu": 99\n}missing
5460Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_002800__64700.05.635320[108, 154]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_002800__647.json50.0missingmissingmissing
5461Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_024820__73900.05.763610[122, 174]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_024820__739.json50.0missing{\n "num_gpu": 99\n}missing
5462Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231225_024823__46600.03.452260[122, 97]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_024823__466.json0.0missing{\n "num_gpu": 99\n}missing
5463Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_232151__21300.02.518410[122, 65]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_232151__213.json50.0missing{\n "num_gpu": 99\n}missing
5464Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231214_002754__19900.014.37290[184, 387]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002754__199.json0.0missingmissingmissing
5465Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_024807__47550.011.91943[198, 184]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024807__475.json100.0missing{\n "num_gpu": 99\n}missing
5466Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_024814__14000.07.28220[198, 209]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024814__140.json50.0missing{\n "num_gpu": 99\n}missing
5467Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_232148__34340.013.16672[198, 239]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232148__343.json86.6667missing{\n "num_gpu": 99\n}missing
5468Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231214_002854__41300.017.65850[11, 482]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_002854__413.json50.0missingmissingmissing
5469Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_024915__24300.07.484890[389, 182]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024915__243.json50.0missing{\n "num_gpu": 99\n}missing
5470Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_024922__29150.07.655943[389, 188]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_024922__291.json100.0missing{\n "num_gpu": 99\n}missing
5471Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231226_232207__95800.03.992280[389, 70]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232207__958.json0.0missing{\n "num_gpu": 99\n}missing
5472Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231214_002837__74500.019.77930[379, 453]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_002837__745.json50.0missingmissingmissing
5473Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_024852__19050.09.983893[387, 262]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_024852__190.json100.0missing{\n "num_gpu": 99\n}missing
5474Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_024907__16600.014.62563[387, 406]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_024907__166.json75.0missing{\n "num_gpu": 99\n}missing
5475Apple-MacBook-Pro-M1clean_columnopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_232203__52350.09.030813[387, 232]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_232203__523.json100.0missing{\n "num_gpu": 99\n}missing
5476Apple-MacBook-Pro-M1clean_columnorca2:13bAsIs1SHOTfalsefalse520231214_003644__90700.06.729520[62, 202]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__AsIs__1SHOT__20231214_003644__907.json0.0missingmissingmissing
5477Apple-MacBook-Pro-M1clean_columnorca2:13bAsIs1SHOTfalsefalse520231225_030530__44900.010.94480[79, 193]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__AsIs__1SHOT__20231225_030530__449.json0.0missing{\n "num_gpu": 99\n}missing
5478Apple-MacBook-Pro-M1clean_columnorca2:13bAsIs1SHOTfalsefalse520231225_030536__98800.06.528230[79, 110]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__AsIs__1SHOT__20231225_030536__988.json0.0missing{\n "num_gpu": 99\n}missing
5479Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTtruetrue520231214_003637__78700.013.5980[79, 403]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231214_003637__787.json50.0missingmissingmissing
5480Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTtruetrue520231225_030513__27100.08.109210[82, 139]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231225_030513__271.json50.0missing{\n "num_gpu": 99\n}missing
5481Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTfalsefalse520231225_030519__54300.05.927230[82, 98]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231225_030519__543.json0.0missing{\n "num_gpu": 99\n}missing
5482Apple-MacBook-Pro-M1clean_columnorca2:13bInJulia1SHOTtruetrue520231226_232909__97800.08.14730[82, 141]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__InJulia__1SHOT__20231226_232909__978.json50.0missing{\n "num_gpu": 99\n}missing
5483Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_003623__65800.06.385480[108, 177]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_003623__658.json50.0missingmissingmissing
5484Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_030500__37200.05.101590[121, 78]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_030500__372.json0.0missing{\n "num_gpu": 99\n}missing
5485Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_030504__29400.04.80680[121, 72]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_030504__294.json0.0missing{\n "num_gpu": 99\n}missing
5486Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_232900__59800.04.658080[121, 69]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_232900__598.json0.0missing{\n "num_gpu": 99\n}missing
5487Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_003617__30900.09.709110[184, 254]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003617__309.json50.0missingmissingmissing
5488Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231225_030439__34200.024.6810[197, 249]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030439__342.json25.0missing{\n "num_gpu": 99\n}missing
5489Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_030454__76300.015.16040[197, 250]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030454__763.json50.0missing{\n "num_gpu": 99\n}missing
5490Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231226_232856__63200.023.6560[197, 243]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232856__632.json50.0missing{\n "num_gpu": 99\n}missing
5491Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_003714__30100.011.37020[11, 316]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003714__301.json50.0missingmissingmissing
5492Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_030642__30700.07.678720[385, 80]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030642__307.json0.0missing{\n "num_gpu": 99\n}missing
5493Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_030702__45200.019.89750[385, 299]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030702__452.json0.0missing{\n "num_gpu": 99\n}missing
5494Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231226_232952__45400.025.45670[385, 398]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232952__454.json50.0missing{\n "num_gpu": 99\n}missing
5495Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTtruetrue520231214_003702__81100.018.41490[379, 418]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_003702__811.json50.0missingmissingmissing
5496Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_030614__62900.038.18910[382, 617]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_030614__629.json0.0missing{\n "num_gpu": 99\n}missing
5497Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTtruetrue520231225_030634__45100.019.85910[382, 303]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_030634__451.json50.0missing{\n "num_gpu": 99\n}missing
5498Apple-MacBook-Pro-M1clean_columnorca2:13bJuliaRecapTask1SHOTtruetrue520231226_232927__15500.018.03610[382, 272]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_232927__155.json50.0missing{\n "num_gpu": 99\n}missing
5499Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_231358__67600.06.239930[62, 188]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_231358__676.json0.0missingmissingmissing
5500Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_231404__62000.06.544730[1, 210]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_231404__620.json0.0missingmissingmissing
5501Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_231410__39700.05.802840[1, 187]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_231410__397.json0.0missingmissingmissing
5502Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_231330__53700.010.32750[79, 308]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_231330__537.json0.0missingmissingmissing
5503Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_231341__96400.010.92160[1, 342]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_231341__964.json0.0missingmissingmissing
5504Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTtruetrue520231219_231352__56700.011.03460[1, 345]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_231352__567.json50.0missingmissingmissing
5505Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231226_233923__72000.013.29790[72, 508]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231226_233923__720.json0.0missing{\n "num_gpu": 99\n}missing
5506Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231219_231306__35600.05.601340[108, 154]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_231306__356.json50.0missingmissingmissing
5507Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231219_231312__18200.05.793470[1, 184]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_231312__182.json50.0missingmissingmissing
5508Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_231319__16900.07.762620[1, 244]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_231319__169.json0.0missingmissingmissing
5509Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_233909__93900.018.10330[109, 674]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_233909__939.json0.0missing{\n "num_gpu": 99\n}missing
5510Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231219_231235__42200.014.58963[184, 395]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231235__422.json75.0missingmissingmissing
5511Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_231246__57400.011.04880[1, 333]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231246__574.json0.0missingmissingmissing
5512Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231219_231300__56600.014.32690[1, 425]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231300__566.json50.0missingmissingmissing
5513Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_233851__65100.05.238120[183, 49]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233851__651.json0.0missing{\n "num_gpu": 99\n}missing
5514Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231219_231522__34900.023.60750[11, 632]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231522__349.json50.0missingmissingmissing
5515Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231219_231542__42300.019.23790[1, 528]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231542__423.json0.0missingmissingmissing
5516Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_231553__59500.011.46610[1, 325]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_231553__595.json25.0missingmissingmissing
5517Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_233934__92400.06.291270[361, 193]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233934__924.json0.0missing{\n "num_gpu": 99\n}missing
5518Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_231426__29100.015.84910[379, 351]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_231426__291.json0.0missingmissingmissing
5519Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231219_231443__12100.016.96240[1, 470]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_231443__121.json50.0missingmissingmissing
5520Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_231459__48700.015.56660[1, 434]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_231459__487.json0.0missingmissingmissing
5521Apple-MacBook-Pro-M1clean_columnphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231226_233927__40900.04.926570[358, 142]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_233927__409.json0.0missing{\n "num_gpu": 99\n}missing
5522Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_003746__18500.05.28910[62, 157]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_003746__185.json0.0missingmissingmissing
5523Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_030942__90300.015.90260[87, 114]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_030942__903.json0.0missing{\n "num_gpu": 99\n}missing
5524Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_030956__90500.014.67670[87, 104]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_030956__905.json0.0missing{\n "num_gpu": 99\n}missing
5525Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTfalsefalse520231214_003741__34800.09.238320[79, 274]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_003741__348.json0.0missingmissingmissing
5526Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_030900__13140.025.65673[90, 193]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_030900__131.json95.0missing{\n "num_gpu": 99\n}missing
5527Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_030926__72230.025.15712[90, 189]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_030926__722.json81.6667missing{\n "num_gpu": 99\n}missing
5528Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2InJulia1SHOTtruetrue520231226_233110__68530.020.96882[90, 155]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_233110__685.json81.6667missing{\n "num_gpu": 99\n}missing
5529Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_003732__45000.07.687990[108, 217]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_003732__450.json0.0missingmissingmissing
5530Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_030811__96740.011.26342[129, 66]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_030811__967.json86.6667missing{\n "num_gpu": 99\n}missing
5531Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_030835__85430.023.97292[129, 169]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_030835__854.json81.6667missing{\n "num_gpu": 99\n}missing
5532Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_233049__59940.014.01423[129, 89]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_233049__599.json95.0missing{\n "num_gpu": 99\n}missing
5533Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_003724__33100.010.20010[184, 268]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003724__331.json0.0missingmissingmissing
5534Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231225_030737__82000.035.12580[205, 65]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030737__820.json0.0missing{\n "num_gpu": 99\n}missing
5535Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_030759__10730.022.40252[205, 145]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030759__107.json81.6667missing{\n "num_gpu": 99\n}missing
5536Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_233035__21040.042.91612[205, 142]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233035__210.json86.6667missing{\n "num_gpu": 99\n}missing
5537Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231214_003821__68100.018.44290[11, 501]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003821__681.json50.0missingmissingmissing
5538Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_031118__81540.028.17663[393, 156]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031118__815.json95.0missing{\n "num_gpu": 99\n}missing
5539Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_031144__17350.026.00463[393, 139]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_031144__173.json100.0missing{\n "num_gpu": 99\n}missing
5540Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231226_233205__70640.034.55793[393, 207]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233205__706.json95.0missing{\n "num_gpu": 99\n}missing
5541Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_003802__18000.015.93890[379, 352]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_003802__180.json50.0missingmissingmissing
5542Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_031033__84140.036.44283[390, 222]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_031033__841.json95.0missing{\n "num_gpu": 99\n}missing
5543Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_031050__67150.016.74063[390, 67]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_031050__671.json100.0missing{\n "num_gpu": 99\n}missing
5544Apple-MacBook-Pro-M1clean_columnphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_233130__19150.019.93643[390, 93]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_233130__191.json100.0missing{\n "num_gpu": 99\n}missing
5545Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_230326__99800.011.67790[62, 353]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_230326__998.json0.0missingmissingmissing
5546Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_230331__13500.05.547440[1, 179]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_230331__135.json0.0missingmissingmissing
5547Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_230337__39200.06.0360[1, 194]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_230337__392.json0.0missingmissingmissing
5548Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231219_230300__27800.013.19570[79, 393]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_230300__278.json50.0missingmissingmissing
5549Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_230309__55100.08.842770[1, 280]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_230309__551.json0.0missingmissingmissing
5550Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231219_230314__75500.04.98310[1, 161]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_230314__755.json50.0missingmissingmissing
5551Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231226_233630__53600.012.13260[83, 201]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231226_233630__536.json50.0missing{\n "num_gpu": 99\n}missing
5552Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230236__89000.06.948680[108, 196]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230236__890.json50.0missingmissingmissing
5553Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230242__72300.05.155850[1, 164]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230242__723.json50.0missingmissingmissing
5554Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_230247__38700.05.507090[1, 175]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_230247__387.json50.0missingmissingmissing
5555Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231226_233618__65100.011.68660[124, 188]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231226_233618__651.json50.0missing{\n "num_gpu": 99\n}missing
5556Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230207__35400.07.998540[184, 205]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230207__354.json0.0missingmissingmissing
5557Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_230219__56400.011.75340[1, 353]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230219__564.json0.0missingmissingmissing
5558Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_230229__89500.010.70590[1, 323]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_230229__895.json50.0missingmissingmissing
5559Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_031849__86600.023.28620[200, 214]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_031849__866.json0.0missing{\n "num_gpu": 99\n}missing
5560Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231226_233606__41200.025.28070[200, 257]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231226_233606__412.json25.0missing{\n "num_gpu": 99\n}missing
5561Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230450__18800.022.89730[11, 615]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230450__188.json50.0missingmissingmissing
5562Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230504__47100.014.843[1, 415]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230504__471.json75.0missingmissingmissing
5563Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_230525__19200.020.97840[1, 572]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_230525__192.json50.0missingmissingmissing
5564Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231226_233702__17800.014.36740[391, 191]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231226_233702__178.json50.0missing{\n "num_gpu": 99\n}missing
5565Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_230357__50000.019.03570[379, 435]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230357__500.json0.0missingmissingmissing
5566Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_230416__99400.019.48440[1, 535]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230416__994.json0.0missingmissingmissing
5567Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_230427__74800.010.61060[1, 302]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_230427__748.json50.0missingmissingmissing
5568Apple-MacBook-Pro-M1clean_columnsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231226_233647__38200.016.7220[389, 231]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231226_233647__382.json50.0missing{\n "num_gpu": 99\n}missing
5569Apple-MacBook-Pro-M1clean_columnstablelm-zephyrAsIs1SHOTfalsefalse520231214_003533__24900.05.59970[62, 167]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_003533__249.json0.0missingmissingmissing
5570Apple-MacBook-Pro-M1clean_columnstablelm-zephyrAsIs1SHOTfalsefalse520231225_030349__71500.03.983110[80, 225]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_030349__715.json0.0missing{\n "num_gpu": 99\n}missing
5571Apple-MacBook-Pro-M1clean_columnstablelm-zephyrAsIs1SHOTfalsefalse520231225_030353__30700.03.983460[80, 225]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_030353__307.json0.0missing{\n "num_gpu": 99\n}missing
5572Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTfalsefalse520231214_003527__69000.012.44820[79, 370]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_003527__690.json0.0missingmissingmissing
5573Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTfalsefalse520231225_030342__43200.04.326450[83, 245]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_030342__432.json0.0missing{\n "num_gpu": 99\n}missing
5574Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTtruetrue520231225_030345__98200.03.569450[83, 201]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_030345__982.json50.0missing{\n "num_gpu": 99\n}missing
5575Apple-MacBook-Pro-M1clean_columnstablelm-zephyrInJulia1SHOTfalsefalse520231226_232824__35400.02.958550[83, 165]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_232824__354.json0.0missing{\n "num_gpu": 99\n}missing
5576Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_003515__38900.08.45580[108, 240]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_003515__389.json0.0missingmissingmissing
5577Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231225_030335__59900.01.356950[120, 65]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_030335__599.json50.0missing{\n "num_gpu": 99\n}missing
5578Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231225_030337__99100.02.058190[120, 106]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_030337__991.json50.0missing{\n "num_gpu": 99\n}missing
5579Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231226_232821__28800.01.91880[120, 98]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_232821__288.json50.0missing{\n "num_gpu": 99\n}missing
5580Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231214_003506__61800.016.78290[184, 454]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003506__618.json0.0missingmissingmissing
5581Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_030330__12500.07.497920[192, 240]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030330__125.json0.0missing{\n "num_gpu": 99\n}missing
5582Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231225_030334__36400.04.266583[192, 220]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_030334__364.json75.0missing{\n "num_gpu": 99\n}missing
5583Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_232819__49900.05.269380[192, 123]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232819__499.json0.0missing{\n "num_gpu": 99\n}missing
5584Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231214_003607__71700.017.00850[11, 464]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003607__717.json50.0missingmissingmissing
5585Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_030409__27000.07.322030[370, 336]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030409__270.json50.0missing{\n "num_gpu": 99\n}missing
5586Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_030415__86000.05.91280[370, 263]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_030415__860.json0.0missing{\n "num_gpu": 99\n}missing
5587Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_232832__82300.03.741053[370, 148]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232832__823.json75.0missing{\n "num_gpu": 99\n}missing
5588Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_003550__88000.017.3370[379, 389]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_003550__880.json50.0missingmissingmissing
5589Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_030357__47300.03.672840[368, 144]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_030357__473.json0.0missing{\n "num_gpu": 99\n}missing
5590Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_030401__57500.03.931860[368, 159]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_030401__575.json50.0missing{\n "num_gpu": 99\n}missing
5591Apple-MacBook-Pro-M1clean_columnstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231226_232828__89900.04.719950[368, 200]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_232828__899.json50.0missing{\n "num_gpu": 99\n}missing
5592Apple-MacBook-Pro-M1clean_columnstarling-lm:latestAsIs1SHOTfalsefalse520231214_002936__34200.013.29790[62, 399]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_002936__342.json0.0missingmissingmissing
5593Apple-MacBook-Pro-M1clean_columnstarling-lm:latestAsIs1SHOTfalsefalse520231225_025022__80400.06.122780[80, 191]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_025022__804.json0.0missing{\n "num_gpu": 99\n}missing
5594Apple-MacBook-Pro-M1clean_columnstarling-lm:latestAsIs1SHOTfalsefalse520231225_025030__97100.07.884650[80, 250]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_025030__971.json0.0missing{\n "num_gpu": 99\n}missing
5595Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231214_002922__13840.09.718593[79, 289]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_002922__138.json95.0missingmissingmissing
5596Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231225_025011__96500.06.236120[83, 194]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_025011__965.json50.0missing{\n "num_gpu": 99\n}missing
5597Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231225_025016__46300.04.96520[83, 152]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_025016__463.json50.0missing{\n "num_gpu": 99\n}missing
5598Apple-MacBook-Pro-M1clean_columnstarling-lm:latestInJulia1SHOTtruetrue520231226_232234__64950.04.881083[83, 150]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_232234__649.json100.0missing{\n "num_gpu": 99\n}missing
5599Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_002913__46100.05.600710[108, 153]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_002913__461.json50.0missingmissingmissing
5600Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_024958__38900.04.606810[124, 135]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_024958__389.json50.0missing{\n "num_gpu": 99\n}missing
5601Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_025005__57400.06.253470[124, 190]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_025005__574.json50.0missing{\n "num_gpu": 99\n}missing
5602Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_232229__98500.05.135470[124, 153]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_232229__985.json50.0missing{\n "num_gpu": 99\n}missing
5603Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231214_002907__41000.012.43370[184, 333]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_002907__410.json50.0missingmissingmissing
5604Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231225_024944__23700.021.07840[200, 472]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024944__237.json0.0missing{\n "num_gpu": 99\n}missing
5605Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_024954__43820.09.893023[200, 292]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_024954__438.json85.0missing{\n "num_gpu": 99\n}missing
5606Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231226_232223__11300.016.77750[200, 350]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232223__113.json50.0missing{\n "num_gpu": 99\n}missing
5607Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_003014__32700.020.39630[11, 551]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003014__327.json0.0missingmissingmissing
5608Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_025051__58750.07.854623[391, 194]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025051__587.json100.0missing{\n "num_gpu": 99\n}missing
5609Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_025059__74500.08.637620[391, 218]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025059__745.json50.0missing{\n "num_gpu": 99\n}missing
5610Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_232301__24100.014.05330[391, 389]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232301__241.json50.0missing{\n "num_gpu": 99\n}missing
5611Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_002954__78500.017.82910[379, 402]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_002954__785.json50.0missingmissingmissing
5612Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_025037__41000.06.587740[389, 153]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_025037__410.json50.0missing{\n "num_gpu": 99\n}missing
5613Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_025043__80700.05.648140[389, 123]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_025043__807.json50.0missing{\n "num_gpu": 99\n}missing
5614Apple-MacBook-Pro-M1clean_columnstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_232247__84400.012.95140[389, 355]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_232247__844.json50.0missing{\n "num_gpu": 99\n}missing
5615Apple-MacBook-Pro-M1clean_columnyi:34b-chatAsIs1SHOTfalsefalse520231214_003052__49900.06.316280[62, 190]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_003052__499.json0.0missingmissingmissing
5616Apple-MacBook-Pro-M1clean_columnyi:34b-chatAsIs1SHOTfalsefalse520231225_025426__25900.044.8920[75, 336]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_025426__259.json0.0missing{\n "num_gpu": 99\n}missing
5617Apple-MacBook-Pro-M1clean_columnyi:34b-chatAsIs1SHOTfalsefalse520231225_025458__43400.032.21630[75, 238]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_025458__434.json0.0missing{\n "num_gpu": 99\n}missing
5618Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTfalsefalse520231214_003045__28400.010.23760[79, 304]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_003045__284.json0.0missingmissingmissing
5619Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTtruetrue520231225_025300__75850.040.48183[78, 302]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_025300__758.json100.0missing{\n "num_gpu": 99\n}missing
5620Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTtruetrue520231225_025341__51050.040.88673[78, 305]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_025341__510.json100.0missing{\n "num_gpu": 99\n}missing
5621Apple-MacBook-Pro-M1clean_columnyi:34b-chatInJulia1SHOTtruetrue520231226_232440__99400.048.46992[78, 365]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_232440__994.json66.6667missing{\n "num_gpu": 99\n}missing
5622Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231214_003035__70700.05.23280[108, 142]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_003035__707.json0.0missingmissingmissing
5623Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_025157__36400.08.57650[117, 47]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_025157__364.json50.0missing{\n "num_gpu": 99\n}missing
5624Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231225_025219__83100.021.78830[117, 151]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_025219__831.json0.0missing{\n "num_gpu": 99\n}missing
5625Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_232352__81400.07.64093[117, 40]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_232352__814.json75.0missing{\n "num_gpu": 99\n}missing
5626Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_003030__12600.015.77080[184, 427]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003030__126.json50.0missingmissingmissing
5627Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_025136__78000.036.63133[192, 65]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025136__780.json75.0missing{\n "num_gpu": 99\n}missing
5628Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_025149__71700.012.5720[192, 68]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_025149__717.json25.0missing{\n "num_gpu": 99\n}missing
5629Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231226_232344__58450.043.11683[192, 132]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_232344__584.json100.0missing{\n "num_gpu": 99\n}missing
5630Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_003122__42000.018.55280[11, 504]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003122__420.json0.0missingmissingmissing
5631Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_025713__77450.064.95763[391, 422]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025713__774.json100.0missing{\n "num_gpu": 99\n}missing
5632Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_025832__72200.078.75420[391, 522]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_025832__722.json50.0missing{\n "num_gpu": 99\n}missing
5633Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231226_232632__42300.062.61213[391, 407]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_232632__423.json75.0missing{\n "num_gpu": 99\n}missing
5634Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruefalse520231214_003103__18700.011.48660[379, 231]0.10.0-DEV31.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_003103__187.json25.0missingmissingmissing
5635Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_025534__41550.036.34883[389, 211]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_025534__415.json100.0missing{\n "num_gpu": 99\n}missing
5636Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_025608__63700.033.42010[389, 189]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_025608__637.json25.0missing{\n "num_gpu": 99\n}missing
5637Apple-MacBook-Pro-M1clean_columnyi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_232529__96750.049.29283[389, 309]0.10.0-DEV31.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/clean_column/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_232529__967.json100.0missing{\n "num_gpu": 99\n}missing
5638Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructAsIs1SHOTfalsefalse520231214_004641__98600.014.01650[107, 403]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_004641__986.json0.0missingmissingmissing
5639Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructAsIs1SHOTfalsefalse520231225_171450__34500.023.53260[129, 420]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_171450__345.json0.0missing{\n "num_gpu": 99\n}missing
5640Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructAsIs1SHOTfalsefalse520231225_171512__55300.022.10940[129, 394]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_171512__553.json0.0missing{\n "num_gpu": 99\n}missing
5641Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruetrue520231214_004626__45810.015.88631[124, 453]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_004626__458.json60.0missingmissingmissing
5642Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruetrue520231225_171358__90610.014.84611[132, 259]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_171358__906.json60.0missing{\n "num_gpu": 99\n}missing
5643Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruetrue520231225_171426__56300.027.79130[132, 497]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_171426__563.json50.0missing{\n "num_gpu": 99\n}missing
5644Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructInJulia1SHOTtruefalse520231226_235127__50100.014.99840[132, 260]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231226_235127__501.json25.0missing{\n "num_gpu": 99\n}missing
5645Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_004610__80910.014.2271[153, 395]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_004610__809.json60.0missingmissingmissing
5646Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_171330__50400.08.517820[170, 134]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_171330__504.json50.0missing{\n "num_gpu": 99\n}missing
5647Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_171343__47240.012.65665[170, 212]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_171343__472.json95.0missing{\n "num_gpu": 99\n}missing
5648Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231226_235112__30300.016.69360[170, 286]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231226_235112__303.json50.0missing{\n "num_gpu": 99\n}missing
5649Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231214_004556__24900.019.74050[300, 485]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004556__249.json0.0missingmissingmissing
5650Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_171302__92930.023.84355[318, 214]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171302__929.json90.0missing{\n "num_gpu": 99\n}missing
5651Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_171322__53300.019.4320[318, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171322__533.json50.0missing{\n "num_gpu": 99\n}missing
5652Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231226_235055__38410.026.26821[318, 264]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235055__384.json60.0missing{\n "num_gpu": 99\n}missing
5653Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231214_004703__54000.07.649380[11, 210]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004703__540.json0.0missingmissingmissing
5654Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_171635__89300.036.29260[435, 580]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171635__893.json50.0missing{\n "num_gpu": 99\n}missing
5655Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_171701__84800.025.76240[435, 399]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171701__848.json50.0missing{\n "num_gpu": 99\n}missing
5656Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231226_235219__98800.022.63990[435, 343]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235219__988.json50.0missing{\n "num_gpu": 99\n}missing
5657Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_004656__69700.015.00890[424, 305]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_004656__697.json0.0missingmissingmissing
5658Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_171540__58810.028.31161[432, 444]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_171540__588.json60.0missing{\n "num_gpu": 99\n}missing
5659Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_171558__72050.018.32145[432, 268]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_171558__720.json100.0missing{\n "num_gpu": 99\n}missing
5660Apple-MacBook-Pro-M1event_schedulercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231226_235157__14400.030.06820[432, 472]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231226_235157__144.json50.0missing{\n "num_gpu": 99\n}missing
5661NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004320__32810.03.081041[0, 232]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004320__328.json60.0missing{\n "num_gpu": 99\n}missing
5662NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004324__53010.03.065521[0, 231]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004324__530.json60.0missing{\n "num_gpu": 99\n}missing
5663NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004327__55400.03.661950[0, 262]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004327__554.json50.0missing{\n "num_gpu": 99\n}missing
5664NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004333__87600.05.4320[0, 396]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004333__876.json50.0missing{\n "num_gpu": 99\n}missing
5665NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004342__51100.09.040440[0, 656]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004342__511.json50.0missing{\n "num_gpu": 99\n}missing
5666NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004236__36300.05.551870[0, 404]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004236__363.json50.0missing{\n "num_gpu": 99\n}missing
5667NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004240__59400.03.489830[0, 256]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004240__594.json50.0missing{\n "num_gpu": 99\n}missing
5668NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004243__55650.03.28575[0, 241]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004243__556.json100.0missing{\n "num_gpu": 99\n}missing
5669NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004247__39900.03.234470[0, 237]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004247__399.json50.0missing{\n "num_gpu": 99\n}missing
5670NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004250__52520.02.98534[0, 219]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004250__525.json80.0missing{\n "num_gpu": 99\n}missing
5671NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004159__69730.03.849875[0, 279]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004159__697.json90.0missing{\n "num_gpu": 99\n}missing
5672NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004204__38110.05.632791[0, 405]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004204__381.json60.0missing{\n "num_gpu": 99\n}missing
5673NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004208__71500.03.150740[0, 228]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004208__715.json50.0missing{\n "num_gpu": 99\n}missing
5674NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004213__77200.05.285250[0, 386]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004213__772.json50.0missing{\n "num_gpu": 99\n}missing
5675NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004217__49010.03.463221[0, 255]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004217__490.json60.0missing{\n "num_gpu": 99\n}missing
5676NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004451__78500.05.955340[0, 423]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004451__785.json50.0missing{\n "num_gpu": 99\n}missing
5677NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004457__72820.06.680245[0, 473]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004457__728.json85.0missing{\n "num_gpu": 99\n}missing
5678NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004500__33500.02.137770[0, 154]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004500__335.json50.0missing{\n "num_gpu": 99\n}missing
5679NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004502__42410.01.877841[0, 138]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004502__424.json60.0missing{\n "num_gpu": 99\n}missing
5680NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_004504__36400.02.462950[0, 181]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004504__364.json0.0missing{\n "num_gpu": 99\n}missing
5681NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004404__51200.03.937440[0, 281]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004404__512.json50.0missing{\n "num_gpu": 99\n}missing
5682NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004407__78400.02.625110[0, 188]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004407__784.json50.0missing{\n "num_gpu": 99\n}missing
5683NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_004411__73700.03.607870[0, 258]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004411__737.json0.0missing{\n "num_gpu": 99\n}missing
5684NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_004416__59400.05.302510[0, 378]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004416__594.json0.0missing{\n "num_gpu": 99\n}missing
5685NVIDIA-RTX-4090-4xevent_schedulercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004420__59110.04.063571[0, 290]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004420__591.json60.0missing{\n "num_gpu": 99\n}missing
5686Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonAsIs1SHOTfalsefalse520231214_004825__43600.021.70210[107, 615]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_004825__436.json0.0missingmissingmissing
5687Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonInJulia1SHOTfalsefalse520231214_004803__56100.014.7470[124, 422]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_004803__561.json0.0missingmissingmissing
5688Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_171750__21400.08.598460[106, 146]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_171750__214.json0.0missing{\n "num_gpu": 99\n}missing
5689Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_171809__47500.019.31630[106, 348]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_171809__475.json0.0missing{\n "num_gpu": 99\n}missing
5690Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_004748__48000.017.47150[153, 485]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_004748__480.json0.0missingmissingmissing
5691Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_171733__76300.08.123220[107, 137]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_171733__763.json25.0missing{\n "num_gpu": 99\n}missing
5692Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_171741__33700.08.288830[107, 140]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_171741__337.json25.0missing{\n "num_gpu": 99\n}missing
5693Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_004731__70310.027.51781[300, 683]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004731__703.json60.0missingmissingmissing
5694Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_171717__40100.016.54290[193, 95]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171717__401.json0.0missing{\n "num_gpu": 99\n}missing
5695Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_171725__49200.07.320470[193, 106]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_171725__492.json0.0missing{\n "num_gpu": 99\n}missing
5696Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231214_004935__51500.034.55780[11, 880]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004935__515.json0.0missingmissingmissing
5697Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_172135__21800.01.610380[124, 11]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172135__218.json0.0missing{\n "num_gpu": 99\n}missing
5698Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_172137__34700.01.557440[124, 10]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172137__347.json0.0missing{\n "num_gpu": 99\n}missing
5699Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_004901__20600.035.61180[424, 817]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_004901__206.json0.0missingmissingmissing
5700Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_172121__76300.040.57560[121, 728]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_172121__763.json0.0missing{\n "num_gpu": 99\n}missing
5701Apple-MacBook-Pro-M1event_schedulercodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_172133__76600.012.59630[121, 221]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_172133__766.json0.0missing{\n "num_gpu": 99\n}missing
5702NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_005144__61100.08.867090[0, 315]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_005144__611.json50.0missing{\n "num_gpu": 99\n}missing
5703NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_005153__98500.08.897890[0, 315]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_005153__985.json50.0missing{\n "num_gpu": 99\n}missing
5704NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_005200__98400.06.790820[0, 243]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_005200__984.json50.0missing{\n "num_gpu": 99\n}missing
5705NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_005211__23900.010.89270[0, 391]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_005211__239.json50.0missing{\n "num_gpu": 99\n}missing
5706NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_005222__97800.011.39950[0, 410]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_005222__978.json50.0missing{\n "num_gpu": 99\n}missing
5707NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_005011__88800.04.530260[0, 161]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_005011__888.json50.0missing{\n "num_gpu": 99\n}missing
5708NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_005022__42400.011.30580[0, 400]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_005022__424.json50.0missing{\n "num_gpu": 99\n}missing
5709NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_005031__32000.08.132760[0, 288]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_005031__320.json50.0missing{\n "num_gpu": 99\n}missing
5710NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_005038__80000.07.5090[0, 266]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_005038__800.json50.0missing{\n "num_gpu": 99\n}missing
5711NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_005047__55400.08.827380[0, 313]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_005047__554.json50.0missing{\n "num_gpu": 99\n}missing
5712NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_004849__95600.06.680280[0, 239]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004849__956.json0.0missing{\n "num_gpu": 99\n}missing
5713NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_004856__35300.06.760070[0, 242]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004856__353.json0.0missing{\n "num_gpu": 99\n}missing
5714NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_004905__45900.09.428610[0, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004905__459.json0.0missing{\n "num_gpu": 99\n}missing
5715NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004915__49440.09.820165[0, 350]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004915__494.json95.0missing{\n "num_gpu": 99\n}missing
5716NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004925__74400.010.32250[0, 368]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004925__744.json50.0missing{\n "num_gpu": 99\n}missing
5717NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_005525__65830.012.61075[0, 447]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_005525__658.json90.0missing{\n "num_gpu": 99\n}missing
5718NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_005533__59300.07.517710[0, 267]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_005533__593.json0.0missing{\n "num_gpu": 99\n}missing
5719NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_005539__50600.06.43570[0, 229]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_005539__506.json0.0missing{\n "num_gpu": 99\n}missing
5720NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_005543__49200.03.729130[0, 133]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_005543__492.json50.0missing{\n "num_gpu": 99\n}missing
5721NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_005548__34600.05.108780[0, 182]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_005548__346.json0.0missing{\n "num_gpu": 99\n}missing
5722NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_005332__53800.023.31290[0, 814]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_005332__538.json50.0missing{\n "num_gpu": 99\n}missing
5723NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_005348__90400.016.69050[0, 591]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_005348__904.json50.0missing{\n "num_gpu": 99\n}missing
5724NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_005411__95200.022.20720[0, 778]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_005411__952.json50.0missing{\n "num_gpu": 99\n}missing
5725NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_005416__61800.05.396230[0, 189]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_005416__618.json50.0missing{\n "num_gpu": 99\n}missing
5726NVIDIA-RTX-4090-4xevent_schedulercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_005427__42300.010.83160[0, 379]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_005427__423.json0.0missing{\n "num_gpu": 99\n}missing
5727NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_003541__70600.010.72010[0, 260]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_003541__706.json50.0missing{\n "num_gpu": 99\n}missing
5728NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_003605__59210.023.84361[0, 574]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_003605__592.json60.0missing{\n "num_gpu": 99\n}missing
5729NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KInJulia1SHOTtruefalse520240201_003625__31100.020.37480[0, 491]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_003625__311.json25.0missing{\n "num_gpu": 99\n}missing
5730NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KInJulia1SHOTtruefalse520240201_003658__37500.033.00370[0, 791]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_003658__375.json25.0missing{\n "num_gpu": 99\n}missing
5731NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_003712__66600.013.11140[0, 317]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_003712__666.json0.0missing{\n "num_gpu": 99\n}missing
5732NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_003344__11000.017.82480[0, 435]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_003344__110.json0.0missing{\n "num_gpu": 99\n}missing
5733NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_003350__99600.05.370020[0, 132]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_003350__996.json0.0missing{\n "num_gpu": 99\n}missing
5734NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_003403__66910.013.18751[0, 323]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_003403__669.json60.0missing{\n "num_gpu": 99\n}missing
5735NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_003412__54500.09.380860[0, 230]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_003412__545.json0.0missing{\n "num_gpu": 99\n}missing
5736NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_003423__24200.010.19950[0, 250]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_003423__242.json0.0missing{\n "num_gpu": 99\n}missing
5737NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_003141__44210.012.79911[0, 307]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_003141__442.json60.0missing{\n "num_gpu": 99\n}missing
5738NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_003146__81600.04.894940[0, 118]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_003146__816.json0.0missing{\n "num_gpu": 99\n}missing
5739NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_003204__59400.018.08780[0, 432]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_003204__594.json0.0missing{\n "num_gpu": 99\n}missing
5740NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_003217__99100.013.47530[0, 323]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_003217__991.json0.0missing{\n "num_gpu": 99\n}missing
5741NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_003233__13540.016.12874[0, 386]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_003233__135.json90.0missing{\n "num_gpu": 99\n}missing
5742NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_004000__47200.00.8219050[0, 20]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004000__472.json0.0missing{\n "num_gpu": 99\n}missing
5743NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_004015__41110.014.96341[0, 361]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004015__411.json60.0missing{\n "num_gpu": 99\n}missing
5744NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruefalse520240201_004054__98900.039.2330[0, 936]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004054__989.json25.0missing{\n "num_gpu": 99\n}missing
5745NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_004103__58300.08.368940[0, 202]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004103__583.json0.0missing{\n "num_gpu": 99\n}missing
5746NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_004124__35610.020.99871[0, 503]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004124__356.json60.0missing{\n "num_gpu": 99\n}missing
5747NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_003832__46100.017.47070[0, 420]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_003832__461.json0.0missing{\n "num_gpu": 99\n}missing
5748NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_003845__14700.013.19080[0, 317]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_003845__147.json0.0missing{\n "num_gpu": 99\n}missing
5749NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_003857__77800.012.60130[0, 303]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_003857__778.json0.0missing{\n "num_gpu": 99\n}missing
5750NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_003906__92000.08.537370[0, 206]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_003906__920.json0.0missing{\n "num_gpu": 99\n}missing
5751NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_003914__83400.07.475790[0, 177]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_003914__834.json0.0missing{\n "num_gpu": 99\n}missing
5752NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_002117__12400.020.24240[0, 378]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_002117__124.json50.0missing{\n "num_gpu": 99\n}missing
5753NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_002139__80000.022.32630[0, 416]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_002139__800.json50.0missing{\n "num_gpu": 99\n}missing
5754NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_002202__79350.023.00665[0, 429]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_002202__793.json100.0missing{\n "num_gpu": 99\n}missing
5755NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_002230__26100.027.23480[0, 507]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_002230__261.json0.0missing{\n "num_gpu": 99\n}missing
5756NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_002240__78200.09.975210[0, 187]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_002240__782.json0.0missing{\n "num_gpu": 99\n}missing
5757NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_001737__51600.017.18880[0, 321]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_001737__516.json50.0missing{\n "num_gpu": 99\n}missing
5758NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_001754__64500.016.33770[0, 305]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_001754__645.json0.0missing{\n "num_gpu": 99\n}missing
5759NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_001824__39810.030.70361[0, 570]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_001824__398.json60.0missing{\n "num_gpu": 99\n}missing
5760NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_001849__93300.023.97350[0, 446]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_001849__933.json0.0missing{\n "num_gpu": 99\n}missing
5761NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_001858__15400.09.529750[0, 178]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_001858__154.json0.0missing{\n "num_gpu": 99\n}missing
5762NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_001431__23500.020.62170[0, 378]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_001431__235.json50.0missing{\n "num_gpu": 99\n}missing
5763NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_001449__19300.016.82550[0, 309]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_001449__193.json50.0missing{\n "num_gpu": 99\n}missing
5764NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_001503__83300.013.80710[0, 254]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_001503__833.json0.0missing{\n "num_gpu": 99\n}missing
5765NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_001516__18210.013.82841[0, 254]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_001516__182.json60.0missing{\n "num_gpu": 99\n}missing
5766NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_001530__62510.013.33491[0, 246]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_001530__625.json60.0missing{\n "num_gpu": 99\n}missing
5767NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_002747__23200.08.271030[0, 153]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_002747__232.json0.0missing{\n "num_gpu": 99\n}missing
5768NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_002758__80210.011.71771[0, 217]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_002758__802.json60.0missing{\n "num_gpu": 99\n}missing
5769NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_002832__62200.033.790[0, 622]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_002832__622.json0.0missing{\n "num_gpu": 99\n}missing
5770NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_002847__50010.014.50631[0, 268]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_002847__500.json60.0missing{\n "num_gpu": 99\n}missing
5771NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_002920__74400.033.28950[0, 613]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_002920__744.json0.0missing{\n "num_gpu": 99\n}missing
5772NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_002431__96400.09.838760[0, 182]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_002431__964.json0.0missing{\n "num_gpu": 99\n}missing
5773NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_002457__80100.025.95390[0, 478]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_002457__801.json50.0missing{\n "num_gpu": 99\n}missing
5774NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_002526__65000.029.20620[0, 538]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_002526__650.json50.0missing{\n "num_gpu": 99\n}missing
5775NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_002543__14710.016.06961[0, 297]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_002543__147.json60.0missing{\n "num_gpu": 99\n}missing
5776NVIDIA-RTX-4090-4xevent_schedulercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_002603__80830.020.25475[0, 374]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_002603__808.json90.0missing{\n "num_gpu": 99\n}missing
5777NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004613__30040.02.302595[0, 265]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004613__300.json95.0missing{\n "num_gpu": 99\n}missing
5778NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004616__67510.03.662171[0, 422]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004616__675.json60.0missing{\n "num_gpu": 99\n}missing
5779NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004619__40810.02.396841[0, 278]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004619__408.json60.0missing{\n "num_gpu": 99\n}missing
5780NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004622__63600.02.761310[0, 319]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004622__636.json50.0missing{\n "num_gpu": 99\n}missing
5781NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_004625__51240.02.278244[0, 264]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_004625__512.json90.0missing{\n "num_gpu": 99\n}missing
5782NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004550__11300.03.246140[0, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004550__113.json50.0missing{\n "num_gpu": 99\n}missing
5783NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_004553__92500.03.172610[0, 359]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004553__925.json50.0missing{\n "num_gpu": 99\n}missing
5784NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_004555__80000.01.382560[0, 160]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004555__800.json0.0missing{\n "num_gpu": 99\n}missing
5785NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_004556__16300.01.242060[0, 144]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004556__163.json0.0missing{\n "num_gpu": 99\n}missing
5786NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_004557__99200.00.9657320[0, 112]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_004557__992.json0.0missing{\n "num_gpu": 99\n}missing
5787NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004525__78210.02.537181[0, 300]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004525__782.json60.0missing{\n "num_gpu": 99\n}missing
5788NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004528__42010.02.846911[0, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004528__420.json60.0missing{\n "num_gpu": 99\n}missing
5789NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004531__82010.03.569811[0, 419]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004531__820.json60.0missing{\n "num_gpu": 99\n}missing
5790NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_004533__48900.01.304260[0, 155]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004533__489.json0.0missing{\n "num_gpu": 99\n}missing
5791NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_004535__87010.02.177551[0, 250]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_004535__870.json60.0missing{\n "num_gpu": 99\n}missing
5792NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_004714__12800.03.478850[0, 404]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004714__128.json0.0missing{\n "num_gpu": 99\n}missing
5793NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004718__21300.04.003340[0, 465]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004718__213.json50.0missing{\n "num_gpu": 99\n}missing
5794NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004721__16030.03.141165[0, 367]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004721__160.json90.0missing{\n "num_gpu": 99\n}missing
5795NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004724__48210.03.460561[0, 401]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004724__482.json60.0missing{\n "num_gpu": 99\n}missing
5796NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_004728__88810.03.681961[0, 429]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_004728__888.json60.0missing{\n "num_gpu": 99\n}missing
5797NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004643__39910.02.402851[0, 271]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004643__399.json60.0missing{\n "num_gpu": 99\n}missing
5798NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004647__95700.04.216020[0, 473]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004647__957.json50.0missing{\n "num_gpu": 99\n}missing
5799NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004648__49900.00.9232560[0, 104]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004648__499.json50.0missing{\n "num_gpu": 99\n}missing
5800NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_004651__71850.02.872225[0, 323]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004651__718.json100.0missing{\n "num_gpu": 99\n}missing
5801NVIDIA-RTX-4090-4xevent_schedulercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_004653__76300.01.705940[0, 193]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_004653__763.json0.0missing{\n "num_gpu": 99\n}missing
5802Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_231837__88000.019.06580[107, 545]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_231837__880.json0.0missingmissingmissing
5803Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_231856__55100.019.15870[1, 569]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_231856__551.json0.0missingmissingmissing
5804Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_231915__33400.018.51710[1, 551]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_231915__334.json0.0missingmissingmissing
5805Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue520231225_175150__54010.064.55931[119, 379]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_175150__540.json60.0missing{\n "num_gpu": 99\n}missing
5806Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue520231225_175246__26510.054.4421[119, 317]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_175246__265.json60.0missing{\n "num_gpu": 99\n}missing
5807Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_231759__69800.019.45110[1, 576]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_231759__698.json0.0missingmissingmissing
5808Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231219_231818__23310.019.01311[1, 564]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_231818__233.json60.0missingmissingmissing
5809Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_174957__87550.090.36895[122, 530]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_174957__875.json100.0missing{\n "num_gpu": 99\n}missing
5810Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_175045__69700.047.21210[122, 269]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_175045__697.json50.0missing{\n "num_gpu": 99\n}missing
5811Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_000329__57650.096.80715[122, 580]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_000329__576.json100.0missing{\n "num_gpu": 99\n}missing
5812Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_231707__76600.09.019520[1, 277]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_231707__766.json0.0missingmissingmissing
5813Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_231723__53400.015.35040[1, 458]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_231723__534.json0.0missingmissingmissing
5814Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_174723__29950.062.1235[163, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_174723__299.json100.0missing{\n "num_gpu": 99\n}missing
5815Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_174826__96150.061.55015[163, 351]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_174826__961.json100.0missing{\n "num_gpu": 99\n}missing
5816Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_000151__11550.073.88585[163, 431]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_000151__115.json100.0missing{\n "num_gpu": 99\n}missing
5817Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_231633__42900.012.51580[1, 361]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231633__429.json0.0missingmissingmissing
5818Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_231642__26310.09.437161[1, 276]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_231642__263.json60.0missingmissingmissing
5819Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_174509__53020.0100.0434[310, 400]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_174509__530.json80.0missing{\n "num_gpu": 99\n}missing
5820Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_174621__95110.071.19541[310, 389]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_174621__951.json60.0missing{\n "num_gpu": 99\n}missing
5821Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_000036__38910.090.7591[310, 369]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_000036__389.json60.0missing{\n "num_gpu": 99\n}missing
5822Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231219_232119__55100.020.80470[1, 560]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232119__551.json25.0missingmissingmissing
5823Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_232144__71100.025.19820[1, 668]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232144__711.json0.0missingmissingmissing
5824Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_175643__12540.090.91935[451, 479]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_175643__125.json95.0missing{\n "num_gpu": 99\n}missing
5825Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_175811__72150.086.21695[451, 448]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_175811__721.json100.0missing{\n "num_gpu": 99\n}missing
5826Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_000611__53650.084.20615[451, 439]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_000611__536.json100.0missing{\n "num_gpu": 99\n}missing
5827Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_232007__53700.022.95540[1, 614]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232007__537.json0.0missingmissingmissing
5828Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_232040__37500.032.96070[1, 851]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232040__375.json0.0missingmissingmissing
5829Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_175409__35500.082.43260[449, 429]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_175409__355.json50.0missing{\n "num_gpu": 99\n}missing
5830Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_175511__21550.061.30795[449, 304]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_175511__215.json100.0missing{\n "num_gpu": 99\n}missing
5831Apple-MacBook-Pro-M1event_schedulerdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_000447__19610.077.09411[449, 397]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_000447__196.json60.0missing{\n "num_gpu": 99\n}missing
5832Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_001606__81110.010.46371[121, 395]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_001606__811.json60.0missing{\n "num_gpu": 99\n}missing
5833Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_112433__11300.08.356680[121, 315]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_112433__113.json0.0missing{\n "num_gpu": 99\n}missing
5834Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_112444__28300.010.77850[121, 407]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_112444__283.json0.0missing{\n "num_gpu": 99\n}missing
5835Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_112454__88300.010.05750[121, 380]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_112454__883.json0.0missing{\n "num_gpu": 99\n}missing
5836Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_001556__42500.07.003910[158, 258]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_001556__425.json0.0missing{\n "num_gpu": 99\n}missing
5837Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_112414__76000.010.93440[158, 406]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_112414__760.json0.0missing{\n "num_gpu": 99\n}missing
5838Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_112420__47700.05.868590[158, 214]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_112420__477.json0.0missing{\n "num_gpu": 99\n}missing
5839Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_112425__50000.04.443360[158, 159]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_112425__500.json50.0missing{\n "num_gpu": 99\n}missing
5840Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_001549__22800.011.71970[276, 286]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001549__228.json0.0missing{\n "num_gpu": 99\n}missing
5841Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_112344__37300.013.60850[276, 360]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112344__373.json0.0missing{\n "num_gpu": 99\n}missing
5842Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_112348__92110.04.295831[276, 134]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112348__921.json60.0missing{\n "num_gpu": 99\n}missing
5843Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_112403__47500.014.99050[276, 526]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112403__475.json0.0missing{\n "num_gpu": 99\n}missing
5844Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_001626__65400.013.66690[410, 449]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001626__654.json50.0missing{\n "num_gpu": 99\n}missing
5845Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_112530__83100.07.462890[410, 228]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112530__831.json50.0missing{\n "num_gpu": 99\n}missing
5846Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_112535__77210.05.460745[410, 155]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112535__772.json80.0missing{\n "num_gpu": 99\n}missing
5847Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_112543__55210.07.383781[410, 225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_112543__552.json60.0missing{\n "num_gpu": 99\n}missing
5848Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_001612__49710.05.601511[407, 160]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_001612__497.json60.0missing{\n "num_gpu": 99\n}missing
5849Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_112506__50610.012.36221[407, 403]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_112506__506.json60.0missing{\n "num_gpu": 99\n}missing
5850Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_112512__15700.04.942380[407, 135]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_112512__157.json0.0missing{\n "num_gpu": 99\n}missing
5851Apple-MacBook-Pro-M1event_schedulerdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_112522__28600.010.25540[407, 329]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_112522__286.json50.0missing{\n "num_gpu": 99\n}missing
5852Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_110148__27010.05.175261[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110148__270.json60.0missingmissingmissing
5853Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_110158__22200.010.36481[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110158__222.json55.0missingmissingmissing
5854Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_110205__75100.07.149690[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110205__751.json0.0missingmissingmissing
5855Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_110211__29400.05.700840[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110211__294.json50.0missingmissingmissing
5856Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_110217__63600.06.256830[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110217__636.json50.0missingmissingmissing
5857Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110109__26200.03.647410[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110109__262.json50.0missingmissingmissing
5858Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110112__96400.02.865380[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110112__964.json50.0missingmissingmissing
5859Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110115__23600.02.276050[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110115__236.json50.0missingmissingmissing
5860Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_110118__16700.03.312340[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110118__167.json0.0missingmissingmissing
5861Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110122__60210.03.754961[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110122__602.json60.0missingmissingmissing
5862Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110033__81510.03.060831[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110033__815.json60.0missingmissingmissing
5863Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110036__25400.03.121980[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110036__254.json50.0missingmissingmissing
5864Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_110038__88800.02.312960[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110038__888.json0.0missingmissingmissing
5865Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_110046__17200.07.621710[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110046__172.json0.0missingmissingmissing
5866Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110049__59610.03.328691[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110049__596.json60.0missingmissingmissing
5867Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110338__89700.03.41850[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110338__897.json50.0missingmissingmissing
5868Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_110341__88000.03.196750[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110341__880.json0.0missingmissingmissing
5869Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110350__33210.08.532991[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110350__332.json60.0missingmissingmissing
5870Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_110431__74900.012.78810[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110431__749.json0.0missingmissingmissing
5871Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_113825__24900.03.647790[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_113825__249.json0.0missingmissingmissing
5872Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110252__76400.03.844260[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110252__764.json50.0missingmissingmissing
5873Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110255__31700.03.385610[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110255__317.json50.0missingmissingmissing
5874Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110259__55410.03.660181[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110259__554.json60.0missingmissingmissing
5875Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_110304__50900.04.508460[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110304__509.json0.0missingmissingmissing
5876Apple-MacBook-Pro-M1event_schedulergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110309__82800.05.489360[0, 0]0.13.0-DEV51.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110309__828.json50.0missingmissingmissing
5877Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_225846__30610.024.21071[0, 373]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_225846__306.json60.0missingmissingmissing
5878Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_225915__25200.028.04650[0, 429]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_225915__252.json0.0missingmissingmissing
5879Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_225939__16100.024.31540[0, 373]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_225939__161.json0.0missingmissingmissing
5880Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_230009__91810.029.49141[0, 449]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_230009__918.json60.0missingmissingmissing
5881Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_230035__79310.026.71041[0, 408]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_230035__793.json60.0missingmissingmissing
5882Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_225508__46110.032.99151[0, 503]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_225508__461.json60.0missingmissingmissing
5883Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_225529__42310.020.79821[0, 315]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_225529__423.json60.0missingmissingmissing
5884Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_225553__11510.023.8011[0, 361]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_225553__115.json60.0missingmissingmissing
5885Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_225615__94400.022.3290[0, 340]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_225615__944.json0.0missingmissingmissing
5886Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_225620__38500.05.27470[0, 78]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_225620__385.json25.0missingmissingmissing
5887Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_225116__34310.038.93541[0, 587]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_225116__343.json60.0missingmissingmissing
5888Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_225146__62500.029.68060[0, 454]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_225146__625.json25.0missingmissingmissing
5889Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_225218__88200.031.77280[0, 481]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_225218__882.json0.0missingmissingmissing
5890Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_225242__59300.024.1910[0, 363]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_225242__593.json25.0missingmissingmissing
5891Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_225316__17610.033.73411[0, 510]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_225316__176.json60.0missingmissingmissing
5892Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse520240223_230845__67500.034.70690[0, 524]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_230845__675.json25.0missingmissingmissing
5893Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_230928__36010.043.26251[0, 645]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_230928__360.json60.0missingmissingmissing
5894Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_230955__91710.026.53011[0, 399]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_230955__917.json60.0missingmissingmissing
5895Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_231036__33510.040.61091[0, 606]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_231036__335.json60.0missingmissingmissing
5896Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_231104__39810.027.89451[0, 423]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_231104__398.json60.0missingmissingmissing
5897Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_230343__37710.023.27481[0, 351]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_230343__377.json60.0missingmissingmissing
5898Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_230413__15100.030.21290[0, 458]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_230413__151.json0.0missingmissingmissing
5899Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_230443__92910.030.33281[0, 459]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_230443__929.json60.0missingmissingmissing
5900Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_230514__33100.030.72650[0, 463]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_230514__331.json0.0missingmissingmissing
5901Apple-MacBook-Pro-M1event_schedulergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_230544__58410.029.64231[0, 441]0.13.0-DEV51.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_230544__584.json60.0missingmissingmissing
5902Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboAsIs1SHOTtruetrue520231213_202750__36510.000799514.04651[108, 497]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_202750__365.json60.0missingmissingmissing
5903Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboAsIs1SHOTtruetrue520231225_191436__19310.00070956.681551[108, 437]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_191436__193.json60.0missingmissingmissing
5904Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboAsIs1SHOTtruetrue520231225_191443__97700.0006666.73670[108, 408]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_191443__977.json50.0missingmissingmissing
5905Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo--optimAsIs1SHOTtruetrue520231215_193506__53710.08.286161[108, 368]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_193506__537.json60.00.5missing0.5
5906Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboInJulia1SHOTtruetrue520231213_202734__38440.00068110.02945[111, 417]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_202734__384.json95.0missingmissingmissing
5907Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboInJulia1SHOTtruetrue520231225_191425__70350.0005344.991165[111, 319]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_191425__703.json100.0missingmissingmissing
5908Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboInJulia1SHOTtruetrue520231225_191429__57010.00040953.462951[111, 236]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_191429__570.json60.0missingmissingmissing
5909Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboInJulia1SHOTtruetrue520231227_194926__96230.0005225.332284[111, 311]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_194926__962.json85.0missingmissingmissing
5910Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboInJulia1SHOTtruetrue520231227_194931__66140.0004745.055815[111, 279]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_194931__661.json95.0missingmissingmissing
5911Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_193456__17440.07.479565[111, 346]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_193456__174.json95.00.5missing0.5
5912Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_202723__76400.0005237.402040[146, 300]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_202723__764.json50.0missingmissingmissing
5913Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_191416__86610.0002141.926081[146, 94]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_191416__866.json60.0missingmissingmissing
5914Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_191419__49410.00021551.839431[146, 95]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_191419__494.json60.0missingmissingmissing
5915Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_194916__57610.00043753.825231[146, 243]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_194916__576.json60.0missingmissingmissing
5916Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_194920__28810.0003223.12411[146, 166]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_194920__288.json60.0missingmissingmissing
5917Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_193448__77340.04.153825[146, 199]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_193448__773.json95.00.5missing0.5
5918Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_202716__63100.0003033.474130[255, 117]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202716__631.json0.0missingmissingmissing
5919Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_191412__22100.0004293.280960[255, 201]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191412__221.json0.0missingmissingmissing
5920Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_191414__88900.0003182.471630[255, 127]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191414__889.json0.0missingmissingmissing
5921Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_194910__43000.00034652.817610[255, 146]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194910__430.json0.0missingmissingmissing
5922Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_194912__64500.00028052.364760[255, 102]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194912__645.json0.0missingmissingmissing
5923Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_193444__38500.03.179940[255, 134]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193444__385.json0.00.5missing0.5
5924Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231213_202759__63700.00044854.948740[369, 176]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202759__637.json0.0missingmissingmissing
5925Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_191450__74000.00036451.914790[369, 120]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191450__740.json0.0missingmissingmissing
5926Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_191452__64100.0004022.184370[369, 145]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191452__641.json0.0missingmissingmissing
5927Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_194940__75500.0003692.124130[369, 123]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194940__755.json0.0missingmissingmissing
5928Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_194944__83100.00042153.90830[369, 158]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_194944__831.json0.0missingmissingmissing
5929Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_193512__94400.03.075320[369, 124]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193512__944.json0.00.5missing0.5
5930Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_202754__11800.0003733.974470[368, 126]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_202754__118.json0.0missingmissingmissing
5931Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_191446__48300.00042.46860[368, 144]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_191446__483.json0.0missingmissingmissing
5932Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_191448__81900.00039252.575380[368, 139]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_191448__819.json0.0missingmissingmissing
5933Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_194937__10100.000524.14360[368, 224]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_194937__101.json0.0missingmissingmissing
5934Apple-MacBook-Pro-M1event_schedulergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_194938__62300.00032951.709260[368, 97]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_194938__623.json0.0missingmissingmissing
5935Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_193509__76100.02.904630[368, 130]0.10.0-DEV51.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_193509__761.json0.00.5missing0.5
5936Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200410__50840.0005282.36824[111, 315]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200410__508.json90.0missingmissingmissing
5937Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200412__88400.00034651.631350[111, 194]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200412__884.json50.0missingmissingmissing
5938Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200414__65230.00050552.107884[111, 300]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200414__652.json85.0missingmissingmissing
5939Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200416__56330.0004471.876594[111, 261]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200416__563.json85.0missingmissingmissing
5940Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200418__32400.00047852.168010[111, 282]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200418__324.json50.0missingmissingmissing
5941Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200403__39310.00020051.022811[146, 85]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200403__393.json60.0missingmissingmissing
5942Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200405__43610.00022151.064081[146, 99]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200405__436.json60.0missingmissingmissing
5943Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200406__33910.0002230.9437311[146, 100]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200406__339.json60.0missingmissingmissing
5944Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200407__87900.0002230.9063260[146, 100]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200407__879.json50.0missingmissingmissing
5945Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200408__12440.0002290.8604625[146, 104]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200408__124.json95.0missingmissingmissing
5946Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200355__10250.00040651.401125[255, 186]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200355__102.json100.0missingmissingmissing
5947Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200357__68940.0004471.783665[255, 213]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200357__689.json95.0missingmissingmissing
5948Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200358__50350.00036451.316415[255, 158]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200358__503.json100.0missingmissingmissing
5949Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200400__80450.0005732.089565[255, 297]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200400__804.json100.0missingmissingmissing
5950Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200402__86500.0004291.740550[255, 201]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200402__865.json25.0missingmissingmissing
5951Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200427__42100.0003991.317710[369, 143]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200427__421.json0.0missingmissingmissing
5952Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200427__69800.00027450.6195280[369, 60]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200427__698.json0.0missingmissingmissing
5953Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200428__32800.00039751.202990[369, 142]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200428__328.json0.0missingmissingmissing
5954Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200429__67200.0002460.7243380[369, 41]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200429__672.json0.0missingmissingmissing
5955Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200430__86300.00032251.012270[369, 92]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200430__863.json0.0missingmissingmissing
5956Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200420__21300.00036550.9833890[368, 121]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200420__213.json0.0missingmissingmissing
5957Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200421__59100.0003611.194340[368, 118]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200421__591.json0.0missingmissingmissing
5958Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200422__53400.0004211.420220[368, 158]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200422__534.json0.0missingmissingmissing
5959Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200424__82400.00042551.455540[368, 161]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200424__824.json0.0missingmissingmissing
5960Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200425__27340.0004271.474794[368, 162]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200425__273.json90.0missingmissingmissing
5961Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231213_202819__26530.0006625.175234[108, 277]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_202819__265.json85.0missingmissingmissing
5962Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_191510__27510.0005922.774231[108, 242]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_191510__275.json60.0missingmissingmissing
5963Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_191514__79310.0004942.631161[108, 193]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_191514__793.json60.0missingmissingmissing
5964Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106--optimAsIs1SHOTtruetrue520231215_193528__77500.03.863610[108, 205]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_193528__775.json50.00.9missing0.1
5965Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_202814__31130.0007254.725464[111, 307]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_202814__311.json85.0missingmissingmissing
5966Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_191504__78950.0006613.404245[111, 275]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_191504__789.json100.0missingmissingmissing
5967Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_191507__84040.0007513.662024[111, 320]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_191507__840.json90.0missingmissingmissing
5968Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_194959__66200.0006594.089450[111, 274]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_194959__662.json50.0missingmissingmissing
5969Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_195003__95900.0006874.611990[111, 288]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_195003__959.json50.0missingmissingmissing
5970Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_193524__29900.04.595090[111, 213]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_193524__299.json50.00.9missing0.1
5971Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_202809__75100.0005045.030260[146, 179]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_202809__751.json50.0missingmissingmissing
5972Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_191458__72710.0003361.50561[146, 95]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_191458__727.json60.0missingmissingmissing
5973Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_191500__24110.0003261.329891[146, 90]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_191500__241.json60.0missingmissingmissing
5974Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_194952__62440.0003161.808125[146, 85]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_194952__624.json95.0missingmissingmissing
5975Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_194954__79310.0004182.256951[146, 136]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_194954__793.json60.0missingmissingmissing
5976Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_193519__72050.02.5635[146, 102]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_193519__720.json100.00.9missing0.1
5977Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_202803__59840.0008194.365335[255, 282]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202803__598.json95.0missingmissingmissing
5978Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTfalsefalse520231225_191454__57700.0004411.445190[255, 93]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191454__577.json0.0missingmissingmissing
5979Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_191456__61740.0005912.253275[255, 168]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191456__617.json95.0missingmissingmissing
5980Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_194948__62840.0006313.282835[255, 188]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194948__628.json95.0missingmissingmissing
5981Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_194950__34400.0005292.21730[255, 137]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_194950__344.json25.0missingmissingmissing
5982Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193516__27640.03.663495[255, 204]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193516__276.json95.00.9missing0.1
5983Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231213_202826__72300.0004912.056830[369, 61]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202826__723.json0.0missingmissingmissing
5984Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_191519__35000.0004451.016470[369, 38]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191519__350.json0.0missingmissingmissing
5985Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_191520__82200.0006111.732130[369, 121]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191520__822.json0.0missingmissingmissing
5986Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_195010__19400.0006392.961640[369, 135]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195010__194.json0.0missingmissingmissing
5987Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_195012__45500.0004711.157230[369, 51]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195012__455.json0.0missingmissingmissing
5988Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_193535__34600.02.571330[369, 94]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193535__346.json0.00.9missing0.1
5989Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_202823__24510.0005843.679321[368, 108]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_202823__245.json60.0missingmissingmissing
5990Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_191517__37900.0005821.712930[368, 107]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_191517__379.json0.0missingmissingmissing
5991Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_191518__63500.0004720.9754450[368, 52]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_191518__635.json0.0missingmissingmissing
5992Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_195005__53300.0005861.810[368, 109]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_195005__533.json0.0missingmissingmissing
5993Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_195008__65200.0006222.154460[368, 127]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_195008__652.json0.0missingmissingmissing
5994Apple-MacBook-Pro-M1event_schedulergpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTfalsefalse520231215_193532__97000.03.810[368, 120]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_193532__970.json0.00.9missing0.1
5995Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewInJulia1SHOTtruetrue520240201_090538__40150.0166841.59135[111, 519]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_090538__401.json100.0missingmissingmissing
5996Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewInJulia1SHOTtruetrue520240201_090611__46150.0153933.41385[111, 476]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_090611__461.json100.0missingmissingmissing
5997Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewInJulia1SHOTtruetrue520240201_090648__56040.0160536.36854[111, 498]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_090648__560.json90.0missingmissingmissing
5998Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewInJulia1SHOTtruetrue520240201_090720__49450.0166832.27455[111, 519]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_090720__494.json100.0missingmissingmissing
5999Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewInJulia1SHOTtruetrue520240201_090809__50750.0194748.17175[111, 612]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_090809__507.json100.0missingmissingmissing
6000Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_085946__58740.0063811.42034[146, 164]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_085946__587.json90.0missingmissingmissing
6001Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_085957__72650.0057511.07425[146, 143]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_085957__726.json100.0missingmissingmissing
6002Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_090037__50550.0103739.50085[146, 297]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_090037__505.json100.0missingmissingmissing
6003Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_090050__64650.0066213.47695[146, 172]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_090050__646.json100.0missingmissingmissing
6004Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_090106__57740.0061415.81184[146, 156]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_090106__577.json90.0missingmissingmissing
6005Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_085601__97950.016834.48295[255, 475]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_085601__979.json100.0missingmissingmissing
6006Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_085641__75150.0151839.53275[255, 421]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_085641__751.json100.0missingmissingmissing
6007Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_085722__96050.0179440.39115[255, 513]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_085722__960.json100.0missingmissingmissing
6008Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_085750__97550.013228.5545[255, 355]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_085750__975.json100.0missingmissingmissing
6009Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_085821__14650.015930.05095[255, 445]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_085821__146.json100.0missingmissingmissing
6010Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_091936__55650.0235261.26495[369, 661]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_091936__556.json100.0missingmissingmissing
6011Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_092002__26250.0128725.41965[369, 306]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_092002__262.json100.0missingmissingmissing
6012Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_092023__59240.0121221.50734[369, 281]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_092023__592.json90.0missingmissingmissing
6013Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_092103__34040.0200440.04784[369, 545]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_092103__340.json90.0missingmissingmissing
6014Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_092137__14400.0178833.39930[369, 473]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_092137__144.json50.0missingmissingmissing
6015Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_091215__45150.0163433.84825[368, 422]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_091215__451.json100.0missingmissingmissing
6016Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_091326__12740.0164971.50314[368, 427]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_091326__127.json90.0missingmissingmissing
6017Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_091412__45640.019445.47114[368, 524]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_091412__456.json90.0missingmissingmissing
6018Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_091509__44840.0205157.09484[368, 561]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_091509__448.json90.0missingmissingmissing
6019Apple-MacBook-Pro-M1event_schedulergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_091613__47240.0205463.42144[368, 562]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_091613__472.json90.0missingmissingmissing
6020Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewAsIs1SHOTfalsefalse520231213_203045__69800.0170746.76290[108, 533]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_203045__698.json0.0missingmissingmissing
6021Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewAsIs1SHOTfalsefalse520231225_191727__35900.0144916.59720[108, 447]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_191727__359.json0.0missingmissingmissing
6022Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewAsIs1SHOTtruetrue520231225_191749__64350.0127222.47965[108, 388]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_191749__643.json100.0missingmissingmissing
6023Apple-MacBook-Pro-M1event_schedulergpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_193726__18100.038.07540[108, 440]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_193726__181.json0.00.1missing0.9
6024Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewInJulia1SHOTtruetrue520231213_202957__26350.0151233.28015[111, 467]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_202957__263.json100.0missingmissingmissing
6025Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewInJulia1SHOTtruetrue520231225_191650__70840.0154819.8634[111, 479]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_191650__708.json90.0missingmissingmissing
6026Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewInJulia1SHOTtruetrue520231225_191710__64840.0171919.00974[111, 536]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_191710__648.json90.0missingmissingmissing
6027Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewInJulia1SHOTtruetrue520231227_195141__94840.0155131.29384[111, 480]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_195141__948.json90.0missingmissingmissing
6028Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewInJulia1SHOTtruefalse520231227_195220__79800.0182137.68280[111, 570]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_195220__798.json25.0missingmissingmissing
6029Apple-MacBook-Pro-M1event_schedulergpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_193647__12940.046.1974[111, 537]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_193647__129.json90.00.1missing0.9
6030Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_202923__46440.0056913.00664[146, 141]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_202923__464.json90.0missingmissingmissing
6031Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_191620__26610.0086911.55861[146, 241]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_191620__266.json60.0missingmissingmissing
6032Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_191630__67610.007229.2511[146, 192]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_191630__676.json60.0missingmissingmissing
6033Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_195054__17500.0073111.51970[146, 195]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_195054__175.json50.0missingmissingmissing
6034Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_195110__42450.0067715.66285[146, 177]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_195110__424.json100.0missingmissingmissing
6035Apple-MacBook-Pro-M1event_schedulergpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_193600__63550.014.15945[146, 201]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_193600__635.json100.00.1missing0.9
6036Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_202910__44150.0126644.06735[255, 337]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202910__441.json100.0missingmissingmissing
6037Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_191542__72150.0201321.32885[255, 586]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191542__721.json100.0missingmissingmissing
6038Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_191608__92240.0205524.76744[255, 600]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191608__922.json90.0missingmissingmissing
6039Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231227_195036__60000.0118224.62590[255, 309]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195036__600.json25.0missingmissingmissing
6040Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231227_195042__46400.004325.901070[255, 59]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195042__464.json0.0missingmissingmissing
6041Apple-MacBook-Pro-M1event_schedulergpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_193546__99500.011.47980[255, 159]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193546__995.json0.00.1missing0.9
6042Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapCoTTask1SHOTfalsefalse520231213_203153__67600.0183327.74410[369, 488]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203153__676.json0.0missingmissingmissing
6043Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_191853__53610.0183917.50871[369, 490]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191853__536.json60.0missingmissingmissing
6044Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_191919__96050.0197125.68755[369, 534]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_191919__960.json100.0missingmissingmissing
6045Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruefalse520231227_195358__59300.0190543.31210[369, 512]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195358__593.json25.0missingmissingmissing
6046Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_195436__18650.0161438.17645[369, 415]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195436__186.json100.0missingmissingmissing
6047Apple-MacBook-Pro-M1event_schedulergpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_193900__25800.060.60010[369, 476]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193900__258.json50.00.1missing0.9
6048Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_203125__77500.0205440.27430[368, 562]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_203125__775.json50.0missingmissingmissing
6049Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_191816__11050.0209626.11965[368, 576]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_191816__110.json100.0missingmissingmissing
6050Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_191835__90600.0169117.59120[368, 441]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_191835__906.json50.0missingmissingmissing
6051Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_195249__44110.0139429.30081[368, 342]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_195249__441.json60.0missingmissingmissing
6052Apple-MacBook-Pro-M1event_schedulergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_195314__42300.0132224.31070[368, 318]0.10.0-DEV51.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_195314__423.json50.0missingmissingmissing
6053Apple-MacBook-Pro-M1event_schedulergpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_193759__67400.033.12120[368, 448]0.10.0-DEV51.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_193759__674.json50.00.1missing0.9
6054Apple-MacBook-Pro-M1event_schedulerllama2AsIs1SHOTfalsefalse520231214_003912__77200.014.90020[107, 428]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__AsIs__1SHOT__20231214_003912__772.json0.0missingmissingmissing
6055Apple-MacBook-Pro-M1event_schedulerllama2AsIs1SHOTfalsefalse520231225_165158__35000.014.97590[107, 432]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__AsIs__1SHOT__20231225_165158__350.json0.0missing{\n "num_gpu": 99\n}missing
6056Apple-MacBook-Pro-M1event_schedulerllama2AsIs1SHOTfalsefalse520231225_165213__39500.015.5360[1, 470]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__AsIs__1SHOT__20231225_165213__395.json0.0missing{\n "num_gpu": 99\n}missing
6057Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTtruetrue520231214_003857__67510.015.24011[124, 436]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231214_003857__675.json60.0missingmissingmissing
6058Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTfalsefalse520231225_165128__21000.019.03680[124, 543]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231225_165128__210.json0.0missing{\n "num_gpu": 99\n}missing
6059Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTtruetrue520231225_165142__73610.014.72711[1, 447]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231225_165142__736.json60.0missing{\n "num_gpu": 99\n}missing
6060Apple-MacBook-Pro-M1event_schedulerllama2InJulia1SHOTfalsefalse520231226_234205__11700.013.28360[124, 386]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__InJulia__1SHOT__20231226_234205__117.json0.0missing{\n "num_gpu": 99\n}missing
6061Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTfalsefalse520231214_003841__34800.04.403150[153, 104]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_003841__348.json0.0missingmissingmissing
6062Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTfalsefalse520231225_165056__53600.013.80850[153, 385]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_165056__536.json0.0missing{\n "num_gpu": 99\n}missing
6063Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTtruetrue520231225_165108__79410.011.9551[1, 363]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_165108__794.json60.0missing{\n "num_gpu": 99\n}missing
6064Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertAsk1SHOTtruetrue520231226_234152__84110.016.93561[153, 478]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertAsk__1SHOT__20231226_234152__841.json60.0missing{\n "num_gpu": 99\n}missing
6065Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTfalsefalse520231214_003837__13700.016.06410[300, 387]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_003837__137.json0.0missingmissingmissing
6066Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTtruefalse520231225_165019__28300.022.63320[318, 433]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165019__283.json25.0missing{\n "num_gpu": 99\n}missing
6067Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_165043__41800.023.89320[1, 658]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165043__418.json0.0missing{\n "num_gpu": 99\n}missing
6068Apple-MacBook-Pro-M1event_schedulerllama2JuliaExpertCoTTask1SHOTfalsefalse520231226_234135__61600.014.97130[318, 233]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234135__616.json0.0missing{\n "num_gpu": 99\n}missing
6069Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231214_003958__92700.015.19940[11, 412]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_003958__927.json0.0missingmissingmissing
6070Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_165323__75500.022.25240[11, 592]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165323__755.json0.0missing{\n "num_gpu": 99\n}missing
6071Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_165357__11400.034.14860[1, 879]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165357__114.json0.0missing{\n "num_gpu": 99\n}missing
6072Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapCoTTask1SHOTfalsefalse520231226_234236__77500.018.45740[11, 502]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234236__775.json0.0missing{\n "num_gpu": 99\n}missing
6073Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTfalsefalse520231214_003943__93800.030.86860[424, 705]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_003943__938.json0.0missingmissingmissing
6074Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTtruetrue520231225_165238__20110.024.53271[424, 553]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_165238__201.json60.0missing{\n "num_gpu": 99\n}missing
6075Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTfalsefalse520231225_165300__60600.022.45140[1, 602]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_165300__606.json0.0missing{\n "num_gpu": 99\n}missing
6076Apple-MacBook-Pro-M1event_schedulerllama2JuliaRecapTask1SHOTfalsefalse520231226_234218__37700.012.32870[424, 237]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/llama2/evaluation__JuliaRecapTask__1SHOT__20231226_234218__377.json0.0missing{\n "num_gpu": 99\n}missing
6077Apple-MacBook-Pro-M1event_schedulermagicoderAsIs1SHOTfalsefalse520231214_005048__23600.015.83540[107, 454]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__AsIs__1SHOT__20231214_005048__236.json0.0missingmissingmissing
6078Apple-MacBook-Pro-M1event_schedulermagicoderAsIs1SHOTfalsefalse520231225_172312__33700.010.80180[121, 348]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__AsIs__1SHOT__20231225_172312__337.json0.0missing{\n "num_gpu": 99\n}missing
6079Apple-MacBook-Pro-M1event_schedulermagicoderAsIs1SHOTfalsefalse520231225_172321__14500.08.815660[121, 283]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__AsIs__1SHOT__20231225_172321__145.json0.0missing{\n "num_gpu": 99\n}missing
6080Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231214_005032__55010.016.66281[124, 475]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231214_005032__550.json60.0missingmissingmissing
6081Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231225_172250__37600.016.520[124, 535]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231225_172250__376.json50.0missing{\n "num_gpu": 99\n}missing
6082Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231225_172301__32510.010.09531[124, 325]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231225_172301__325.json60.0missing{\n "num_gpu": 99\n}missing
6083Apple-MacBook-Pro-M1event_schedulermagicoderInJulia1SHOTtruetrue520231226_235303__25210.011.7461[124, 377]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__InJulia__1SHOT__20231226_235303__252.json60.0missing{\n "num_gpu": 99\n}missing
6084Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTfalsefalse520231214_005015__54000.010.99160[153, 303]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_005015__540.json0.0missingmissingmissing
6085Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTtruetrue520231225_172221__34000.010.65090[163, 333]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_172221__340.json50.0missing{\n "num_gpu": 99\n}missing
6086Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTtruetrue520231225_172233__46320.012.26844[163, 387]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_172233__463.json80.0missing{\n "num_gpu": 99\n}missing
6087Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertAsk1SHOTtruetrue520231226_235251__34200.014.07410[163, 442]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231226_235251__342.json50.0missing{\n "num_gpu": 99\n}missing
6088Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_005004__75700.029.14080[300, 723]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005004__757.json0.0missingmissingmissing
6089Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_172156__86800.019.66310[310, 402]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172156__868.json50.0missing{\n "num_gpu": 99\n}missing
6090Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_172210__36200.013.05680[310, 384]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172210__362.json50.0missing{\n "num_gpu": 99\n}missing
6091Apple-MacBook-Pro-M1event_schedulermagicoderJuliaExpertCoTTask1SHOTtruetrue520231226_235237__86410.017.33821[310, 335]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235237__864.json60.0missing{\n "num_gpu": 99\n}missing
6092Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTfalsefalse520231214_005124__78600.012.88780[11, 352]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005124__786.json0.0missingmissingmissing
6093Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_172407__21100.011.95190[427, 324]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172407__211.json50.0missing{\n "num_gpu": 99\n}missing
6094Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_172425__93400.018.21610[427, 515]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172425__934.json50.0missing{\n "num_gpu": 99\n}missing
6095Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapCoTTask1SHOTtruetrue520231226_235332__78630.015.00475[427, 418]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235332__786.json90.0missing{\n "num_gpu": 99\n}missing
6096Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231214_005111__13710.023.24061[424, 518]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_005111__137.json60.0missingmissingmissing
6097Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231225_172340__96710.018.69231[424, 534]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_172340__967.json60.0missing{\n "num_gpu": 99\n}missing
6098Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231225_172354__19100.014.26590[424, 398]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_172354__191.json50.0missing{\n "num_gpu": 99\n}missing
6099Apple-MacBook-Pro-M1event_schedulermagicoderJuliaRecapTask1SHOTtruetrue520231226_235317__57900.013.49320[424, 371]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder/evaluation__JuliaRecapTask__1SHOT__20231226_235317__579.json50.0missing{\n "num_gpu": 99\n}missing
6100Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180522__26600.014.35240[124, 272]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180522__266.json50.0missing{\n "num_gpu": 99\n}missing
6101Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180539__51700.016.92820[124, 323]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180539__517.json50.0missing{\n "num_gpu": 99\n}missing
6102Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180556__89210.017.23631[124, 329]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180556__892.json60.0missing{\n "num_gpu": 99\n}missing
6103Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180426__47910.020.01311[163, 377]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180426__479.json60.0missing{\n "num_gpu": 99\n}missing
6104Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180443__57910.017.20891[163, 322]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180443__579.json60.0missing{\n "num_gpu": 99\n}missing
6105Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180507__66410.023.19921[163, 432]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180507__664.json60.0missing{\n "num_gpu": 99\n}missing
6106Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180322__81510.024.13341[310, 437]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180322__815.json60.0missing{\n "num_gpu": 99\n}missing
6107Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180339__58940.016.57664[310, 292]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180339__589.json90.0missing{\n "num_gpu": 99\n}missing
6108Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_180406__35300.025.36340[310, 460]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180406__353.json25.0missing{\n "num_gpu": 99\n}missing
6109Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180719__98600.027.10190[427, 433]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180719__986.json50.0missing{\n "num_gpu": 99\n}missing
6110Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180743__78600.023.96320[427, 407]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180743__786.json50.0missing{\n "num_gpu": 99\n}missing
6111Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_180801__97700.017.8610[427, 298]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_180801__977.json50.0missing{\n "num_gpu": 99\n}missing
6112Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180608__77010.011.64161[424, 179]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180608__770.json60.0missing{\n "num_gpu": 99\n}missing
6113Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180634__50910.025.1771[424, 436]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180634__509.json60.0missing{\n "num_gpu": 99\n}missing
6114Apple-MacBook-Pro-M1event_schedulermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_180652__56310.016.69921[424, 263]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_180652__563.json60.0missing{\n "num_gpu": 99\n}missing
6115Apple-MacBook-Pro-M1event_schedulermistral-mediumAsIs1SHOTfalsefalse520231213_201221__32600.003427868.608460[119, 384]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__AsIs__1SHOT__20231213_201221__326.json0.0missingmissingmissing
6116Apple-MacBook-Pro-M1event_schedulermistral-mediumAsIs1SHOTtruefalse520231225_192349__89200.0046737212.09750[119, 538]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__AsIs__1SHOT__20231225_192349__892.json25.0missingmissingmissing
6117Apple-MacBook-Pro-M1event_schedulermistral-mediumAsIs1SHOTtruetrue520231225_192358__42110.003573488.957471[119, 402]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__AsIs__1SHOT__20231225_192358__421.json60.0missingmissingmissing
6118Apple-MacBook-Pro-M1event_schedulermistral-medium--optimAsIs1SHOTtruefalse520231215_194114__18100.026.81450[119, 569]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__AsIs__1SHOT__20231215_194114__181.json25.00.9missing0.3
6119Apple-MacBook-Pro-M1event_schedulermistral-mediumInJulia1SHOTtruetrue520231213_201211__87510.0046332811.86631[122, 532]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__InJulia__1SHOT__20231213_201211__875.json60.0missingmissingmissing
6120Apple-MacBook-Pro-M1event_schedulermistral-mediumInJulia1SHOTfalsefalse520231225_192323__76800.0043177711.01680[122, 493]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__InJulia__1SHOT__20231225_192323__768.json0.0missingmissingmissing
6121Apple-MacBook-Pro-M1event_schedulermistral-mediumInJulia1SHOTtruetrue520231225_192336__91700.0050135113.14340[122, 579]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__InJulia__1SHOT__20231225_192336__917.json50.0missingmissingmissing
6122Apple-MacBook-Pro-M1event_schedulermistral-mediumInJulia1SHOTtruetrue520231227_195823__50310.0041074312.67431[122, 467]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__InJulia__1SHOT__20231227_195823__503.json60.0missingmissingmissing
6123Apple-MacBook-Pro-M1event_schedulermistral-mediumInJulia1SHOTtruetrue520231227_195847__28950.0039860823.12395[122, 452]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__InJulia__1SHOT__20231227_195847__289.json100.0missingmissingmissing
6124Apple-MacBook-Pro-M1event_schedulermistral-medium--optimInJulia1SHOTtruetrue520231215_194046__20900.014.85620[122, 587]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__InJulia__1SHOT__20231215_194046__209.json50.00.9missing0.3
6125Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_201159__38530.002465295.692655[161, 251]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_201159__385.json90.0missingmissingmissing
6126Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_192305__31610.0030154113.13571[161, 319]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_192305__316.json60.0missingmissingmissing
6127Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertAsk1SHOTfalsefalse520231225_192312__51300.002651366.810440[161, 274]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_192312__513.json0.0missingmissingmissing
6128Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_195803__57810.0040913817.80411[161, 452]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_195803__578.json60.0missingmissingmissing
6129Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertAsk1SHOTfalsefalse520231227_195810__31300.002772716.59170[161, 289]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_195810__313.json0.0missingmissingmissing
6130Apple-MacBook-Pro-M1event_schedulermistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_194031__64810.05.630521[161, 250]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_194031__648.json60.00.9missing0.3
6131Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertCoTTask1SHOTfalsefalse520231213_201153__40500.0046743520.32360[308, 475]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201153__405.json0.0missingmissingmissing
6132Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_192233__72410.0056127918.00811[308, 591]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192233__724.json60.0missingmissingmissing
6133Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_192251__18310.0054995318.00421[308, 577]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192251__183.json60.0missingmissingmissing
6134Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertCoTTask1SHOTfalsefalse520231227_195714__17200.0059849322.14840[308, 637]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195714__172.json0.0missingmissingmissing
6135Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaExpertCoTTask1SHOTfalsefalse520231227_195745__57800.0092047530.84960[308, 1035]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195745__578.json0.0missingmissingmissing
6136Apple-MacBook-Pro-M1event_schedulermistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_194024__98610.013.6531[308, 606]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194024__986.json60.00.9missing0.3
6137Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_201249__13900.0055295812.42980[424, 542]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201249__139.json50.0missingmissingmissing
6138Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_192449__61100.0061363318.81590[424, 617]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192449__611.json50.0missingmissingmissing
6139Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_192508__56800.0057399218.41440[424, 568]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192508__568.json50.0missingmissingmissing
6140Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231227_200016__96000.0055700312.47820[424, 547]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200016__960.json0.0missingmissingmissing
6141Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231227_200030__65800.0062576814.21480[424, 632]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200030__658.json0.0missingmissingmissing
6142Apple-MacBook-Pro-M1event_schedulermistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_194207__43500.027.94990[424, 563]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194207__435.json50.00.9missing0.3
6143Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapTask1SHOTtruetrue520231213_201236__24400.006395214.94190[421, 650]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_201236__244.json50.0missingmissingmissing
6144Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_192412__42000.0059340713.82310[421, 593]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_192412__420.json50.0missingmissingmissing
6145Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapTask1SHOTfalsefalse520231225_192430__69000.0072446517.59780[421, 755]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_192430__690.json0.0missingmissingmissing
6146Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapTask1SHOTfalsefalse520231227_195920__20800.005990732.21860[421, 600]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_195920__208.json0.0missingmissingmissing
6147Apple-MacBook-Pro-M1event_schedulermistral-mediumJuliaRecapTask1SHOTtruetrue520231227_200003__79100.0053839542.28220[421, 525]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_200003__791.json50.0missingmissingmissing
6148Apple-MacBook-Pro-M1event_schedulermistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_194138__49800.024.01210[421, 492]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_194138__498.json50.00.9missing0.3
6149Apple-MacBook-Pro-M1event_schedulermistral-smallAsIs1SHOTtruetrue520231213_203325__21150.001316018.533615[118, 639]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__AsIs__1SHOT__20231213_203325__211.json100.0missingmissingmissing
6150Apple-MacBook-Pro-M1event_schedulermistral-smallAsIs1SHOTtruetrue520231225_192115__18650.001352879.067395[118, 658]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__AsIs__1SHOT__20231225_192115__186.json100.0missingmissingmissing
6151Apple-MacBook-Pro-M1event_schedulermistral-smallAsIs1SHOTtruetrue520231225_192124__54750.001184097.729815[118, 571]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__AsIs__1SHOT__20231225_192124__547.json100.0missingmissingmissing
6152Apple-MacBook-Pro-M1event_schedulermistral-small--optimAsIs1SHOTtruetrue520231215_193950__59550.07.952565[118, 604]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__AsIs__1SHOT__20231215_193950__595.json100.00.9missing0.3
6153Apple-MacBook-Pro-M1event_schedulermistral-smallInJulia1SHOTtruetrue520231213_203315__76510.001273338.414581[121, 616]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__InJulia__1SHOT__20231213_203315__765.json60.0missingmissingmissing
6154Apple-MacBook-Pro-M1event_schedulermistral-smallInJulia1SHOTfalsefalse520231225_192056__23300.0002218471.157710[121, 74]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__InJulia__1SHOT__20231225_192056__233.json0.0missingmissingmissing
6155Apple-MacBook-Pro-M1event_schedulermistral-smallInJulia1SHOTtruetrue520231225_192105__64010.001397499.184091[121, 680]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__InJulia__1SHOT__20231225_192105__640.json60.0missingmissingmissing
6156Apple-MacBook-Pro-M1event_schedulermistral-smallInJulia1SHOTtruetrue520231227_195602__19430.001515839.98885[121, 741]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__InJulia__1SHOT__20231227_195602__194.json90.0missingmissingmissing
6157Apple-MacBook-Pro-M1event_schedulermistral-smallInJulia1SHOTtruetrue520231227_195611__23910.001248118.21631[121, 603]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__InJulia__1SHOT__20231227_195611__239.json60.0missingmissingmissing
6158Apple-MacBook-Pro-M1event_schedulermistral-small--optimInJulia1SHOTfalsefalse520231215_193942__42400.01.138920[121, 74]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__InJulia__1SHOT__20231215_193942__424.json0.00.9missing0.3
6159Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertAsk1SHOTtruetrue520231213_203305__41930.001030199.340535[162, 477]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_203305__419.json90.0missingmissingmissing
6160Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_192050__62350.0006383143.809595[162, 275]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_192050__623.json100.0missingmissingmissing
6161Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_192054__68510.0005723543.35171[162, 241]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_192054__685.json60.0missingmissingmissing
6162Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_195545__41010.0005820543.406621[162, 246]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_195545__410.json60.0missingmissingmissing
6163Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_195551__44810.0008420145.115821[162, 380]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_195551__448.json60.0missingmissingmissing
6164Apple-MacBook-Pro-M1event_schedulermistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_193940__52810.04.473991[162, 331]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_193940__528.json60.00.9missing0.3
6165Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_203255__95250.0011854416.0185[309, 508]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203255__952.json100.0missingmissingmissing
6166Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_192039__56310.001084566.222485[309, 456]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192039__563.json80.0missingmissingmissing
6167Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_192045__52400.0008886234.937021[309, 355]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192045__524.json55.0missingmissingmissing
6168Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_195534__64410.001088446.185681[309, 458]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195534__644.json60.0missingmissingmissing
6169Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_195541__89940.00107686.207114[309, 452]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195541__899.json90.0missingmissingmissing
6170Apple-MacBook-Pro-M1event_schedulermistral-small--optimJuliaExpertCoTTask1SHOTtruefalse520231215_193935__33700.06.91710[309, 479]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193935__337.json25.00.9missing0.3
6171Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapCoTTask1SHOTtruefalse520231213_203344__17100.001506888.644880[428, 634]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203344__171.json25.0missingmissingmissing
6172Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapCoTTask1SHOTtruefalse520231225_192206__83100.0019802412.05580[428, 878]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192206__831.json25.0missingmissingmissing
6173Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapCoTTask1SHOTtruefalse520231225_192214__61500.001466148.448150[428, 613]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192214__615.json25.0missingmissingmissing
6174Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_195643__19700.00145458.255830[428, 607]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195643__197.json50.0missingmissingmissing
6175Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapCoTTask1SHOTtruefalse520231227_195652__58300.001501068.616530[428, 631]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195652__583.json25.0missingmissingmissing
6176Apple-MacBook-Pro-M1event_schedulermistral-small--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_194010__87300.08.027730[428, 595]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194010__873.json0.00.9missing0.3
6177Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapTask1SHOTtruefalse520231213_203336__94300.001715110.1030[426, 742]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_203336__943.json25.0missingmissingmissing
6178Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapTask1SHOTtruetrue520231225_192138__66510.0017791212.55681[426, 775]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_192138__665.json60.0missingmissingmissing
6179Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapTask1SHOTtruetrue520231225_192153__14610.0022175613.76011[426, 1001]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_192153__146.json60.0missingmissingmissing
6180Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapTask1SHOTtruetrue520231227_195622__67710.001653029.788721[426, 710]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_195622__677.json60.0missingmissingmissing
6181Apple-MacBook-Pro-M1event_schedulermistral-smallJuliaRecapTask1SHOTtruetrue520231227_195633__44740.0018780611.27915[426, 826]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_195633__447.json95.0missingmissingmissing
6182Apple-MacBook-Pro-M1event_schedulermistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_194001__22750.010.33355[426, 742]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_194001__227.json100.00.9missing0.3
6183Apple-MacBook-Pro-M1event_schedulermistral-tinyAsIs1SHOTfalsefalse520231213_203221__41000.0002090456.737640[118, 425]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__AsIs__1SHOT__20231213_203221__410.json0.0missingmissingmissing
6184Apple-MacBook-Pro-M1event_schedulermistral-tinyAsIs1SHOTtruefalse520231225_191953__32800.0001891134.241670[118, 381]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__AsIs__1SHOT__20231225_191953__328.json25.0missingmissingmissing
6185Apple-MacBook-Pro-M1event_schedulermistral-tinyAsIs1SHOTfalsefalse520231225_192000__72000.0003512876.308190[118, 739]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__AsIs__1SHOT__20231225_192000__720.json0.0missingmissingmissing
6186Apple-MacBook-Pro-M1event_schedulermistral-tiny--optimAsIs1SHOTtruetrue520231215_193916__39100.03.909480[118, 444]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__AsIs__1SHOT__20231215_193916__391.json50.00.9missing0.3
6187Apple-MacBook-Pro-M1event_schedulermistral-tinyInJulia1SHOTtruetrue520231213_203214__56100.0001464984.540670[121, 286]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__InJulia__1SHOT__20231213_203214__561.json50.0missingmissingmissing
6188Apple-MacBook-Pro-M1event_schedulermistral-tinyInJulia1SHOTtruetrue520231225_191945__86800.0001732253.064250[121, 345]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__InJulia__1SHOT__20231225_191945__868.json50.0missingmissingmissing
6189Apple-MacBook-Pro-M1event_schedulermistral-tinyInJulia1SHOTtruetrue520231225_191949__95000.0002266794.103580[121, 463]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__InJulia__1SHOT__20231225_191949__950.json50.0missingmissingmissing
6190Apple-MacBook-Pro-M1event_schedulermistral-tinyInJulia1SHOTfalsefalse520231227_195503__83800.0002665434.921370[121, 551]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__InJulia__1SHOT__20231227_195503__838.json0.0missingmissingmissing
6191Apple-MacBook-Pro-M1event_schedulermistral-tinyInJulia1SHOTtruetrue520231227_195507__91500.0001859093.401760[121, 373]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__InJulia__1SHOT__20231227_195507__915.json50.0missingmissingmissing
6192Apple-MacBook-Pro-M1event_schedulermistral-tiny--optimInJulia1SHOTfalsefalse520231215_193912__27800.03.380170[121, 388]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__InJulia__1SHOT__20231215_193912__278.json0.00.9missing0.3
6193Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_203209__36300.0002043335.822750[162, 401]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_203209__363.json50.0missingmissingmissing
6194Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_191939__56500.0001005962.256350[162, 172]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_191939__565.json50.0missingmissingmissing
6195Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_191942__18900.0001622042.790580[162, 308]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_191942__189.json0.0missingmissingmissing
6196Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertAsk1SHOTfalsefalse520231227_195455__35800.0001794183.198830[162, 346]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_195455__358.json0.0missingmissingmissing
6197Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_195458__55600.0001816833.130710[162, 351]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_195458__556.json50.0missingmissingmissing
6198Apple-MacBook-Pro-M1event_schedulermistral-tiny--optimJuliaExpertAsk1SHOTtruefalse520231215_193908__51400.02.291180[162, 263]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_193908__514.json25.00.9missing0.3
6199Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231213_203203__29700.0002575299.966460[309, 473]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203203__297.json25.0missingmissingmissing
6200Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_191932__56810.00035628311.37041[309, 691]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191932__568.json60.0missingmissingmissing
6201Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231225_191936__54800.0002403154.089880[309, 435]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_191936__548.json25.0missingmissingmissing
6202Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_195446__55300.0002099649.244560[309, 368]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195446__553.json50.0missingmissingmissing
6203Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_195451__17100.0002838034.907610[309, 531]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_195451__171.json50.0missingmissingmissing
6204Apple-MacBook-Pro-M1event_schedulermistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_193905__38600.05.268260[309, 382]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_193905__386.json50.00.9missing0.3
6205Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_203239__79900.00051971513.29080[428, 1015]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203239__799.json50.0missingmissingmissing
6206Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_192028__92300.00042911512.84310[428, 815]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192028__923.json50.0missingmissingmissing
6207Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_192033__14100.0002470094.966810[428, 413]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192033__141.json50.0missingmissingmissing
6208Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_195524__20810.0002628644.182111[428, 448]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195524__208.json60.0missingmissingmissing
6209Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_195528__30200.0002257183.4010[428, 366]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_195528__302.json50.0missingmissingmissing
6210Apple-MacBook-Pro-M1event_schedulermistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_193928__73000.06.411310[428, 703]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_193928__730.json50.00.9missing0.3
6211Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapTask1SHOTfalsefalse520231213_203226__65300.0002295154.871980[426, 375]0.10.0-DEV51.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_203226__653.json0.0missingmissingmissing
6212Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapTask1SHOTtruetrue520231225_192011__67800.00038851811.2270[426, 726]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_192011__678.json50.0missingmissingmissing
6213Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapTask1SHOTfalsefalse520231225_192015__82400.0002752684.301260[426, 476]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_192015__824.json0.0missingmissingmissing
6214Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapTask1SHOTtruetrue520231227_195513__75010.000313325.250051[426, 560]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_195513__750.json60.0missingmissingmissing
6215Apple-MacBook-Pro-M1event_schedulermistral-tinyJuliaRecapTask1SHOTfalsefalse520231227_195520__28900.0003717576.515670[426, 689]0.10.0-DEV51.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_195520__289.json0.0missingmissingmissing
6216Apple-MacBook-Pro-M1event_schedulermistral-tiny--optimJuliaRecapTask1SHOTtruefalse520231215_193921__45500.05.329650[426, 581]0.10.0-DEV51.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_193921__455.json25.00.9missing0.3
6217Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_233018__68900.020.04350[107, 571]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_233018__689.json0.0missingmissingmissing
6218Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_233032__23100.014.71810[1, 446]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_233032__231.json0.0missingmissingmissing
6219Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_233047__71800.014.6160[1, 443]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_233047__718.json0.0missingmissingmissing
6220Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_180529__45600.016.48080[117, 409]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_180529__456.json0.0missing{\n "num_gpu": 99\n}missing
6221Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_180540__56800.011.65540[117, 286]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_180540__568.json0.0missing{\n "num_gpu": 99\n}missing
6222Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_232935__45000.010.01420[1, 310]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_232935__450.json0.0missingmissingmissing
6223Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_232958__19100.022.24510[1, 651]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_232958__191.json0.0missingmissingmissing
6224Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_180456__71910.015.05381[120, 373]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_180456__719.json60.0missing{\n "num_gpu": 99\n}missing
6225Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_180512__27500.016.25330[120, 403]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_180512__275.json25.0missing{\n "num_gpu": 99\n}missing
6226Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231227_000929__46200.013.48520[120, 332]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_000929__462.json0.0missing{\n "num_gpu": 99\n}missing
6227Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_232850__21510.012.23161[1, 370]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232850__215.json60.0missingmissingmissing
6228Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_232902__58510.012.01731[1, 364]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232902__585.json60.0missingmissingmissing
6229Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180430__85700.010.81480[161, 255]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180430__857.json50.0missing{\n "num_gpu": 99\n}missing
6230Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180441__97200.010.320[161, 243]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180441__972.json50.0missing{\n "num_gpu": 99\n}missing
6231Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_000916__41100.012.86790[161, 307]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_000916__411.json50.0missing{\n "num_gpu": 99\n}missing
6232Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_232806__21410.011.23861[1, 326]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232806__214.json60.0missingmissingmissing
6233Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_232818__12200.011.42160[1, 331]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232818__122.json0.0missingmissingmissing
6234Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_180401__95300.021.92710[308, 373]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180401__953.json25.0missing{\n "num_gpu": 99\n}missing
6235Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_180419__84110.018.16831[308, 418]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180419__841.json60.0missing{\n "num_gpu": 99\n}missing
6236Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_000903__30000.038.85340[308, 785]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_000903__300.json0.0missing{\n "num_gpu": 99\n}missing
6237Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_233332__99600.028.74470[1, 752]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233332__996.json0.0missingmissingmissing
6238Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_233356__33400.023.58940[1, 629]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233356__334.json0.0missingmissingmissing
6239Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180641__48010.017.32991[428, 374]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180641__480.json60.0missing{\n "num_gpu": 99\n}missing
6240Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180704__91200.023.24480[428, 519]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180704__912.json50.0missing{\n "num_gpu": 99\n}missing
6241Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_001032__57400.046.12970[428, 1047]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001032__574.json0.0missing{\n "num_gpu": 99\n}missing
6242Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_233203__92200.049.16530[1, 1206]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233203__922.json0.0missingmissingmissing
6243Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_233237__75600.033.22460[1, 857]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233237__756.json0.0missingmissingmissing
6244Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_180556__33000.015.88580[426, 339]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180556__330.json25.0missing{\n "num_gpu": 99\n}missing
6245Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180623__49900.026.94760[426, 608]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180623__499.json50.0missing{\n "num_gpu": 99\n}missing
6246Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_000945__78400.015.89750[426, 340]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_000945__784.json50.0missing{\n "num_gpu": 99\n}missing
6247Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_232730__41400.011.50680[119, 357]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232730__414.json0.0missing{\n "num_gpu": 99\n}missing
6248Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_232749__25600.019.51370[119, 608]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232749__256.json0.0missing{\n "num_gpu": 99\n}missing
6249Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_232804__61000.014.8440[119, 463]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232804__610.json50.0missing{\n "num_gpu": 99\n}missing
6250Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_232817__59840.012.43175[119, 387]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232817__598.json95.0missing{\n "num_gpu": 99\n}missing
6251Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_232836__53100.018.18310[119, 567]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_232836__531.json50.0missing{\n "num_gpu": 99\n}missing
6252Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232645__53400.07.357570[160, 218]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232645__534.json0.0missing{\n "num_gpu": 99\n}missing
6253Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232654__55800.08.376930[160, 251]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232654__558.json0.0missing{\n "num_gpu": 99\n}missing
6254Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232702__19600.08.711170[160, 262]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232702__196.json0.0missing{\n "num_gpu": 99\n}missing
6255Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_232708__33900.06.121620[160, 178]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232708__339.json0.0missing{\n "num_gpu": 99\n}missing
6256Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_232718__72900.09.599530[160, 290]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_232718__729.json50.0missing{\n "num_gpu": 99\n}missing
6257Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_232525__87810.013.75381[307, 373]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232525__878.json60.0missing{\n "num_gpu": 99\n}missing
6258Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_232546__36400.020.03050[307, 582]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232546__364.json0.0missing{\n "num_gpu": 99\n}missing
6259Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_232602__74800.016.16340[307, 462]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232602__748.json0.0missing{\n "num_gpu": 99\n}missing
6260Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_232619__45800.017.30220[307, 501]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232619__458.json25.0missing{\n "num_gpu": 99\n}missing
6261Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_232638__50400.018.44430[307, 534]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_232638__504.json0.0missing{\n "num_gpu": 99\n}missing
6262Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233035__41210.020.63681[427, 573]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233035__412.json60.0missing{\n "num_gpu": 99\n}missing
6263Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233053__30700.017.04210[427, 466]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233053__307.json50.0missing{\n "num_gpu": 99\n}missing
6264Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_233104__89700.010.79460[427, 277]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233104__897.json0.0missing{\n "num_gpu": 99\n}missing
6265Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233118__72200.014.64650[427, 395]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233118__722.json50.0missing{\n "num_gpu": 99\n}missing
6266Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_233141__66500.023.00170[427, 643]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233141__665.json50.0missing{\n "num_gpu": 99\n}missing
6267Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_232851__92300.015.39540[425, 418]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232851__923.json0.0missing{\n "num_gpu": 99\n}missing
6268Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_232905__95600.014.0210[425, 376]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232905__956.json0.0missing{\n "num_gpu": 99\n}missing
6269Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_232931__45300.025.63210[425, 719]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232931__453.json50.0missing{\n "num_gpu": 99\n}missing
6270Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_232952__49300.020.76420[425, 578]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_232952__493.json50.0missing{\n "num_gpu": 99\n}missing
6271Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_233015__14400.023.12230[425, 646]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_233015__144.json50.0missing{\n "num_gpu": 99\n}missing
6272Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233434__32500.012.47160[119, 305]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233434__325.json50.0missing{\n "num_gpu": 99\n}missing
6273Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233449__35100.015.59260[119, 384]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233449__351.json50.0missing{\n "num_gpu": 99\n}missing
6274Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_233505__61900.016.14240[119, 398]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233505__619.json0.0missing{\n "num_gpu": 99\n}missing
6275Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233519__74800.014.04460[119, 345]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233519__748.json50.0missing{\n "num_gpu": 99\n}missing
6276Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_233539__78700.019.66610[119, 486]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_233539__787.json50.0missing{\n "num_gpu": 99\n}missing
6277Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_233346__56100.05.451560[160, 120]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233346__561.json0.0missing{\n "num_gpu": 99\n}missing
6278Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_233357__79500.011.45130[160, 274]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233357__795.json50.0missing{\n "num_gpu": 99\n}missing
6279Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_233403__63800.05.724930[160, 127]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233403__638.json50.0missing{\n "num_gpu": 99\n}missing
6280Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_233409__84900.06.295880[160, 142]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233409__849.json50.0missing{\n "num_gpu": 99\n}missing
6281Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_233421__31500.011.57340[160, 277]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_233421__315.json0.0missing{\n "num_gpu": 99\n}missing
6282Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_233204__61900.023.06430[307, 515]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233204__619.json0.0missing{\n "num_gpu": 99\n}missing
6283Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_233220__88500.015.63090[307, 353]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233220__885.json0.0missing{\n "num_gpu": 99\n}missing
6284Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_233247__46900.026.62270[307, 620]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233247__469.json25.0missing{\n "num_gpu": 99\n}missing
6285Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_233308__54910.021.6721[307, 501]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233308__549.json60.0missing{\n "num_gpu": 99\n}missing
6286Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_233340__44400.031.84060[307, 744]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233340__444.json0.0missing{\n "num_gpu": 99\n}missing
6287Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233807__52000.017.14940[427, 369]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233807__520.json50.0missing{\n "num_gpu": 99\n}missing
6288Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233823__70500.016.12360[427, 344]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233823__705.json50.0missing{\n "num_gpu": 99\n}missing
6289Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_233851__68100.027.8010[427, 624]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233851__681.json0.0missing{\n "num_gpu": 99\n}missing
6290Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233908__99810.017.60261[427, 380]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233908__998.json60.0missing{\n "num_gpu": 99\n}missing
6291Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_233934__35000.026.01850[427, 582]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_233934__350.json50.0missing{\n "num_gpu": 99\n}missing
6292Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233607__16810.027.62621[425, 620]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233607__168.json60.0missing{\n "num_gpu": 99\n}missing
6293Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233624__48700.016.38620[425, 350]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233624__487.json50.0missing{\n "num_gpu": 99\n}missing
6294Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233642__30500.018.02150[425, 390]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233642__305.json50.0missing{\n "num_gpu": 99\n}missing
6295Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_233718__28800.036.35490[425, 823]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233718__288.json25.0missing{\n "num_gpu": 99\n}missing
6296Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_233749__66000.031.33840[425, 707]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_233749__660.json50.0missing{\n "num_gpu": 99\n}missing
6297Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KAsIs1SHOTtruefalse520231226_121656__48700.024.30260[116, 444]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_121656__487.json25.0missing{\n "num_gpu": 99\n}missing
6298Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KAsIs1SHOTtruetrue520231226_121714__43700.018.06110[116, 328]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_121714__437.json50.0missing{\n "num_gpu": 99\n}missing
6299Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_121612__69000.024.21210[119, 442]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121612__690.json50.0missing{\n "num_gpu": 99\n}missing
6300Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_121632__29500.019.7970[119, 357]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_121632__295.json0.0missing{\n "num_gpu": 99\n}missing
6301Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_001435__14900.016.19570[119, 292]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_001435__149.json50.0missing{\n "num_gpu": 99\n}missing
6302Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_121529__65700.07.858320[160, 132]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121529__657.json50.0missing{\n "num_gpu": 99\n}missing
6303Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_121548__20900.017.8740[160, 320]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_121548__209.json50.0missing{\n "num_gpu": 99\n}missing
6304Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_001419__63700.08.139280[160, 137]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_001419__637.json50.0missing{\n "num_gpu": 99\n}missing
6305Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_121457__54600.019.14970[307, 324]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121457__546.json25.0missing{\n "num_gpu": 99\n}missing
6306Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_121521__77200.023.69480[307, 407]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121521__772.json25.0missing{\n "num_gpu": 99\n}missing
6307Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_001411__92400.041.72231[307, 573]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001411__924.json55.0missing{\n "num_gpu": 99\n}missing
6308Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_121906__89100.038.70660[427, 658]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121906__891.json50.0missing{\n "num_gpu": 99\n}missing
6309Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_121939__59500.033.17040[427, 560]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_121939__595.json25.0missing{\n "num_gpu": 99\n}missing
6310Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_001537__40400.024.08530[427, 396]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001537__404.json50.0missing{\n "num_gpu": 99\n}missing
6311Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121747__67800.032.52710[425, 549]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121747__678.json50.0missing{\n "num_gpu": 99\n}missing
6312Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_121827__74300.040.09550[425, 683]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_121827__743.json50.0missing{\n "num_gpu": 99\n}missing
6313Apple-MacBook-Pro-M1event_schedulermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231227_001513__90100.037.40310[425, 633]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_001513__901.json50.0missing{\n "num_gpu": 99\n}missing
6314Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_113356__53410.075.03691[123, 438]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_113356__534.json60.0missing{\n "num_gpu": 99\n}missing
6315Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_113523__57500.086.43530[123, 506]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_113523__575.json50.0missing{\n "num_gpu": 99\n}missing
6316Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_113623__73010.059.46731[123, 345]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_113623__730.json60.0missing{\n "num_gpu": 99\n}missing
6317Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_150553__66510.099.54541[123, 581]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_150553__665.json60.0missing{\n "num_gpu": 99\n}missing
6318Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_150710__95910.076.6651[123, 446]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_150710__959.json60.0missing{\n "num_gpu": 99\n}missing
6319Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_113139__44510.063.78521[162, 361]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_113139__445.json60.0missing{\n "num_gpu": 99\n}missing
6320Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_113204__94100.024.15180[162, 121]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_113204__941.json0.0missing{\n "num_gpu": 99\n}missing
6321Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_113241__66300.037.41150[162, 202]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_113241__663.json0.0missing{\n "num_gpu": 99\n}missing
6322Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_150321__20610.027.08971[162, 138]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_150321__206.json60.0missing{\n "num_gpu": 99\n}missing
6323Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_150413__93500.052.19420[162, 290]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_150413__935.json50.0missing{\n "num_gpu": 99\n}missing
6324Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_112734__23610.0110.7921[313, 586]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112734__236.json60.0missing{\n "num_gpu": 99\n}missing
6325Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_112854__17810.079.00731[313, 426]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_112854__178.json60.0missing{\n "num_gpu": 99\n}missing
6326Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_113035__65600.0101.5560[313, 557]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_113035__656.json25.0missing{\n "num_gpu": 99\n}missing
6327Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_150034__58800.0123.3061[313, 679]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_150034__588.json55.0missing{\n "num_gpu": 99\n}missing
6328Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_150253__14210.0138.9561[313, 767]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_150253__142.json60.0missing{\n "num_gpu": 99\n}missing
6329Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_114041__40200.033.2490[436, 132]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114041__402.json0.0missing{\n "num_gpu": 99\n}missing
6330Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_114239__44510.0118.5981[436, 627]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114239__445.json60.0missing{\n "num_gpu": 99\n}missing
6331Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_114428__89610.0108.7131[436, 571]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114428__896.json60.0missing{\n "num_gpu": 99\n}missing
6332Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_151151__13110.086.91611[436, 444]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_151151__131.json60.0missing{\n "num_gpu": 99\n}missing
6333Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_151312__19240.080.03275[436, 404]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_151312__192.json95.0missing{\n "num_gpu": 99\n}missing
6334Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_113821__13000.0118.7490[434, 628]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_113821__130.json0.0missing{\n "num_gpu": 99\n}missing
6335Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_113923__60640.061.89815[434, 301]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_113923__606.json95.0missing{\n "num_gpu": 99\n}missing
6336Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_114008__72510.043.84811[434, 195]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_114008__725.json60.0missing{\n "num_gpu": 99\n}missing
6337Apple-MacBook-Pro-M1event_schedulernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_151024__56200.044.20580[434, 195]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_151024__562.json50.0missing{\n "num_gpu": 99\n}missing
6338Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_233641__16300.017.42320[107, 500]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_233641__163.json0.0missingmissingmissing
6339Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_233657__76600.015.54210[1, 469]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_233657__766.json0.0missingmissingmissing
6340Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231219_233714__66800.017.41280[1, 521]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231219_233714__668.json0.0missingmissingmissing
6341Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_180854__50600.011.76040[125, 287]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_180854__506.json0.0missing{\n "num_gpu": 99\n}missing
6342Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_180910__79900.016.17250[125, 400]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_180910__799.json0.0missing{\n "num_gpu": 99\n}missing
6343Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_233603__62800.015.83160[1, 477]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_233603__628.json0.0missingmissingmissing
6344Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231219_233624__72700.021.27820[1, 625]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231219_233624__727.json0.0missingmissingmissing
6345Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_180826__12010.018.14241[128, 450]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_180826__120.json60.0missing{\n "num_gpu": 99\n}missing
6346Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_180842__17910.015.51971[128, 383]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_180842__179.json60.0missing{\n "num_gpu": 99\n}missing
6347Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_001122__71600.012.10050[128, 296]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_001122__716.json50.0missing{\n "num_gpu": 99\n}missing
6348Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_233519__80300.010.75590[1, 328]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_233519__803.json0.0missingmissingmissing
6349Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_233529__35600.010.03930[1, 307]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_233529__356.json0.0missingmissingmissing
6350Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180757__84800.09.850690[169, 230]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180757__848.json50.0missing{\n "num_gpu": 99\n}missing
6351Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_180808__64000.010.91630[169, 257]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_180808__640.json50.0missing{\n "num_gpu": 99\n}missing
6352Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_001110__57100.08.856530[169, 204]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_001110__571.json50.0missing{\n "num_gpu": 99\n}missing
6353Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231219_233441__73300.018.88360[1, 530]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_233441__733.json25.0missingmissingmissing
6354Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_233456__28600.014.81990[1, 423]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_233456__286.json0.0missingmissingmissing
6355Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_180729__19300.024.86180[316, 425]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180729__193.json50.0missing{\n "num_gpu": 99\n}missing
6356Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_180747__26100.017.05230[316, 389]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_180747__261.json50.0missing{\n "num_gpu": 99\n}missing
6357Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_001101__24000.029.2190[316, 540]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001101__240.json50.0missing{\n "num_gpu": 99\n}missing
6358Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_233905__39600.023.59680[1, 629]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233905__396.json0.0missingmissingmissing
6359Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_233937__74210.031.95011[1, 827]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_233937__742.json60.0missingmissingmissing
6360Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_181009__87340.024.12065[436, 539]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181009__873.json95.0missing{\n "num_gpu": 99\n}missing
6361Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_181031__15700.020.89910[436, 459]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181031__157.json50.0missing{\n "num_gpu": 99\n}missing
6362Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_001233__12700.032.45170[436, 733]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001233__127.json50.0missing{\n "num_gpu": 99\n}missing
6363Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_233807__91900.027.69540[1, 728]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233807__919.json0.0missingmissingmissing
6364Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_233825__78810.018.20461[1, 496]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_233825__788.json60.0missingmissingmissing
6365Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180933__95310.022.74271[434, 506]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180933__953.json60.0missing{\n "num_gpu": 99\n}missing
6366Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180945__16940.011.20365[434, 224]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180945__169.json95.0missing{\n "num_gpu": 99\n}missing
6367Apple-MacBook-Pro-M1event_scheduleropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_001200__50400.038.16190[434, 865]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_001200__504.json50.0missing{\n "num_gpu": 99\n}missing
6368Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_004107__43700.017.53340[107, 502]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_004107__437.json0.0missingmissingmissing
6369Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_165532__37900.012.64290[123, 402]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_165532__379.json0.0missing{\n "num_gpu": 99\n}missing
6370Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_165542__10700.09.906550[123, 313]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_165542__107.json0.0missing{\n "num_gpu": 99\n}missing
6371Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231214_004050__46410.018.2081[124, 518]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_004050__464.json60.0missingmissingmissing
6372Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_165506__86510.09.556821[126, 301]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_165506__865.json60.0missing{\n "num_gpu": 99\n}missing
6373Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_165519__27900.013.23020[126, 420]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_165519__279.json50.0missing{\n "num_gpu": 99\n}missing
6374Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralInJulia1SHOTtruetrue520231226_234315__81710.09.522481[126, 298]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231226_234315__817.json60.0missing{\n "num_gpu": 99\n}missing
6375Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_004031__80310.013.92041[153, 386]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_004031__803.json60.0missingmissingmissing
6376Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_165447__51510.013.24251[167, 409]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_165447__515.json60.0missing{\n "num_gpu": 99\n}missing
6377Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_165456__35510.07.833311[167, 234]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_165456__355.json60.0missing{\n "num_gpu": 99\n}missing
6378Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231226_234306__42010.011.48011[167, 351]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231226_234306__420.json60.0missing{\n "num_gpu": 99\n}missing
6379Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_004017__32100.019.19330[300, 470]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004017__321.json25.0missingmissingmissing
6380Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_165418__32100.020.59971[314, 454]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165418__321.json55.0missing{\n "num_gpu": 99\n}missing
6381Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_165434__92510.015.96581[314, 470]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165434__925.json60.0missing{\n "num_gpu": 99\n}missing
6382Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231226_234254__53140.017.77565[314, 369]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234254__531.json95.0missing{\n "num_gpu": 99\n}missing
6383Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231214_004152__45110.023.1061[11, 611]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004152__451.json60.0missingmissingmissing
6384Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_165633__75310.018.17811[434, 512]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165633__753.json60.0missing{\n "num_gpu": 99\n}missing
6385Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_165645__97800.011.68720[434, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165645__978.json50.0missing{\n "num_gpu": 99\n}missing
6386Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231226_234352__34110.023.89491[434, 679]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234352__341.json60.0missing{\n "num_gpu": 99\n}missing
6387Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231214_004129__50900.021.84590[424, 483]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_004129__509.json0.0missingmissingmissing
6388Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_165557__81510.015.18811[432, 419]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_165557__815.json60.0missing{\n "num_gpu": 99\n}missing
6389Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_165615__75700.017.41340[432, 489]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_165615__757.json50.0missing{\n "num_gpu": 99\n}missing
6390Apple-MacBook-Pro-M1event_scheduleropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231226_234328__12510.012.43091[432, 333]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231226_234328__125.json60.0missing{\n "num_gpu": 99\n}missing
6391Apple-MacBook-Pro-M1event_schedulerorca2:13bAsIs1SHOTfalsefalse520231214_005431__98600.016.26560[107, 466]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__AsIs__1SHOT__20231214_005431__986.json0.0missingmissingmissing
6392Apple-MacBook-Pro-M1event_schedulerorca2:13bAsIs1SHOTfalsefalse520231225_172851__93100.05.241910[124, 80]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__AsIs__1SHOT__20231225_172851__931.json0.0missing{\n "num_gpu": 99\n}missing
6393Apple-MacBook-Pro-M1event_schedulerorca2:13bAsIs1SHOTfalsefalse520231225_172854__22300.03.180490[124, 41]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__AsIs__1SHOT__20231225_172854__223.json0.0missing{\n "num_gpu": 99\n}missing
6394Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTtruetrue520231214_005415__85410.016.67291[124, 476]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231214_005415__854.json60.0missingmissingmissing
6395Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTfalsefalse520231225_172843__31000.02.660470[127, 31]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231225_172843__310.json0.0missing{\n "num_gpu": 99\n}missing
6396Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTfalsefalse520231225_172846__82300.02.984910[127, 37]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231225_172846__823.json0.0missing{\n "num_gpu": 99\n}missing
6397Apple-MacBook-Pro-M1event_schedulerorca2:13bInJulia1SHOTfalsefalse520231226_235520__19600.02.862390[127, 35]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__InJulia__1SHOT__20231226_235520__196.json0.0missing{\n "num_gpu": 99\n}missing
6398Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_005358__99900.012.11321[153, 335]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_005358__999.json55.0missingmissingmissing
6399Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_172825__25900.06.556950[166, 95]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_172825__259.json0.0missing{\n "num_gpu": 99\n}missing
6400Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTtruetrue520231225_172840__14500.014.94240[166, 251]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_172840__145.json50.0missing{\n "num_gpu": 99\n}missing
6401Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertAsk1SHOTfalsefalse520231226_235517__68900.021.17460[166, 367]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231226_235517__689.json0.0missing{\n "num_gpu": 99\n}missing
6402Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231214_005346__57600.017.1730[300, 417]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005346__576.json0.0missingmissingmissing
6403Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_172744__44400.066.05610[313, 899]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172744__444.json50.0missing{\n "num_gpu": 99\n}missing
6404Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_172819__25000.034.24860[313, 559]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172819__250.json0.0missing{\n "num_gpu": 99\n}missing
6405Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231226_235456__41500.034.0750[313, 410]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235456__415.json0.0missing{\n "num_gpu": 99\n}missing
6406Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231214_005520__63300.018.64670[11, 500]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005520__633.json0.0missingmissingmissing
6407Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_173147__89800.058.58850[430, 927]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_173147__898.json0.0missing{\n "num_gpu": 99\n}missing
6408Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_173304__85400.076.95580[430, 1201]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_173304__854.json50.0missing{\n "num_gpu": 99\n}missing
6409Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231226_235535__37600.07.856530[430, 79]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235535__376.json0.0missing{\n "num_gpu": 99\n}missing
6410Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTfalsefalse520231214_005502__81400.030.1960[424, 689]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_005502__814.json0.0missingmissingmissing
6411Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTtruetrue520231225_173005__83000.070.16010[427, 1092]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_173005__830.json50.0missing{\n "num_gpu": 99\n}missing
6412Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTtruetrue520231225_173048__55100.043.68860[427, 691]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_173048__551.json50.0missing{\n "num_gpu": 99\n}missing
6413Apple-MacBook-Pro-M1event_schedulerorca2:13bJuliaRecapTask1SHOTfalsefalse520231226_235527__77600.07.471770[427, 72]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231226_235527__776.json0.0missing{\n "num_gpu": 99\n}missing
6414Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_234233__57900.017.00710[107, 488]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_234233__579.json0.0missingmissingmissing
6415Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_234253__69700.019.87520[1, 589]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_234253__697.json0.0missingmissingmissing
6416Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231219_234307__50000.014.04450[1, 427]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231219_234307__500.json0.0missingmissingmissing
6417Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_181207__98000.043.78930[112, 1512]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_181207__980.json0.0missing{\n "num_gpu": 99\n}missing
6418Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_181210__13700.03.542070[112, 129]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_181210__137.json0.0missing{\n "num_gpu": 99\n}missing
6419Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_234156__95000.018.99720[1, 564]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_234156__950.json0.0missingmissingmissing
6420Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231219_234216__69800.019.40420[1, 575]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231219_234216__698.json0.0missingmissingmissing
6421Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_181104__34300.05.258840[115, 196]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_181104__343.json0.0missing{\n "num_gpu": 99\n}missing
6422Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_181123__43400.019.20870[115, 713]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_181123__434.json0.0missing{\n "num_gpu": 99\n}missing
6423Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_001306__88600.022.34780[115, 821]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_001306__886.json0.0missing{\n "num_gpu": 99\n}missing
6424Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231219_234106__56300.011.58960[1, 352]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_234106__563.json0.0missingmissingmissing
6425Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231219_234116__95310.010.10561[1, 309]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231219_234116__953.json60.0missingmissingmissing
6426Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_181047__94200.04.612340[152, 166]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_181047__942.json0.0missing{\n "num_gpu": 99\n}missing
6427Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTtruetrue520231225_181058__71110.010.96371[152, 409]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_181058__711.json60.0missing{\n "num_gpu": 99\n}missing
6428Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_001244__92600.06.506010[152, 239]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_001244__926.json0.0missing{\n "num_gpu": 99\n}missing
6429Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231219_234009__50600.018.33730[1, 516]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234009__506.json25.0missingmissingmissing
6430Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231219_234036__11900.027.44050[1, 745]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234036__119.json0.0missingmissingmissing
6431Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_181036__15900.04.796230[270, 3]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181036__159.json0.0missing{\n "num_gpu": 99\n}missing
6432Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_181043__79800.06.729110[270, 227]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_181043__798.json0.0missing{\n "num_gpu": 99\n}missing
6433Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_001238__36000.04.446130[270, 5]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001238__360.json0.0missing{\n "num_gpu": 99\n}missing
6434Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231219_234513__36400.025.99230[1, 687]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234513__364.json0.0missingmissingmissing
6435Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231219_234539__40100.026.41960[1, 697]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234539__401.json25.0missingmissingmissing
6436Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_181256__98200.017.83930[404, 594]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181256__982.json0.0missing{\n "num_gpu": 99\n}missing
6437Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_181308__20800.011.94650[404, 390]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_181308__208.json0.0missing{\n "num_gpu": 99\n}missing
6438Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_001329__78000.09.536480[404, 304]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001329__780.json0.0missing{\n "num_gpu": 99\n}missing
6439Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_234415__64600.032.07530[1, 831]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_234415__646.json0.0missingmissingmissing
6440Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231219_234433__68200.017.85640[1, 487]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231219_234433__682.json0.0missingmissingmissing
6441Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_181223__23100.012.52730[401, 411]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_181223__231.json0.0missing{\n "num_gpu": 99\n}missing
6442Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_181238__19500.015.57570[401, 517]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_181238__195.json0.0missing{\n "num_gpu": 99\n}missing
6443Apple-MacBook-Pro-M1event_schedulerphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_001320__31400.013.1650[401, 432]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_001320__314.json0.0missing{\n "num_gpu": 99\n}missing
6444Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_005632__23000.022.0770[107, 624]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_005632__230.json0.0missingmissingmissing
6445Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2AsIs1SHOTtruetrue520231225_173903__92940.045.55385[132, 344]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_173903__929.json95.0missing{\n "num_gpu": 99\n}missing
6446Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_174003__75900.060.19090[132, 460]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_174003__759.json0.0missing{\n "num_gpu": 99\n}missing
6447Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruetrue520231214_005610__11710.018.89311[124, 537]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_005610__117.json60.0missingmissingmissing
6448Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_173720__37400.039.3860[135, 294]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_173720__374.json50.0missing{\n "num_gpu": 99\n}missing
6449Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_173817__97250.057.19325[135, 436]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_173817__972.json100.0missing{\n "num_gpu": 99\n}missing
6450Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2InJulia1SHOTtruetrue520231226_235827__86950.031.04595[135, 225]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231226_235827__869.json100.0missing{\n "num_gpu": 99\n}missing
6451Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_005550__65910.013.47891[153, 374]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_005550__659.json60.0missingmissingmissing
6452Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_173547__95410.056.85081[174, 412]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_173547__954.json60.0missing{\n "num_gpu": 99\n}missing
6453Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_173641__97150.052.56655[174, 392]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_173641__971.json100.0missing{\n "num_gpu": 99\n}missing
6454Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231226_235755__18120.051.56635[174, 381]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231226_235755__181.json85.0missing{\n "num_gpu": 99\n}missing
6455Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231214_005537__43510.016.33691[300, 394]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005537__435.json60.0missingmissingmissing
6456Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_173420__72530.076.01865[321, 357]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_173420__725.json90.0missing{\n "num_gpu": 99\n}missing
6457Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_173451__12700.029.9690[321, 178]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_173451__127.json50.0missing{\n "num_gpu": 99\n}missing
6458Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231226_235704__83140.088.39075[321, 476]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235704__831.json95.0missing{\n "num_gpu": 99\n}missing
6459Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_005717__11800.022.43060[11, 593]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005717__118.json0.0missingmissingmissing
6460Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_174240__60050.056.51995[438, 372]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_174240__600.json100.0missing{\n "num_gpu": 99\n}missing
6461Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_174328__87010.048.75371[438, 312]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_174328__870.json60.0missing{\n "num_gpu": 99\n}missing
6462Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231226_235906__72600.09.693170[438, 5]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235906__726.json0.0missing{\n "num_gpu": 99\n}missing
6463Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse520231214_005655__75100.022.5420[424, 499]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_005655__751.json0.0missingmissingmissing
6464Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_174046__71910.042.64735[435, 265]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_174046__719.json80.0missing{\n "num_gpu": 99\n}missing
6465Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_174143__81940.056.39744[435, 371]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_174143__819.json90.0missing{\n "num_gpu": 99\n}missing
6466Apple-MacBook-Pro-M1event_schedulerphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231226_235856__79040.029.11375[435, 159]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231226_235856__790.json95.0missing{\n "num_gpu": 99\n}missing
6467Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_232413__13100.021.85050[107, 620]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_232413__131.json0.0missingmissingmissing
6468Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_232431__90500.018.31680[1, 546]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_232431__905.json0.0missingmissingmissing
6469Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_232456__62400.024.0650[1, 699]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_232456__624.json0.0missingmissingmissing
6470Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_180135__64000.025.62280[125, 428]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_180135__640.json0.0missing{\n "num_gpu": 99\n}missing
6471Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_180156__79100.020.86630[125, 347]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_180156__791.json0.0missing{\n "num_gpu": 99\n}missing
6472Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231219_232336__24010.015.45431[1, 466]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_232336__240.json60.0missingmissingmissing
6473Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231219_232351__64300.015.18440[1, 459]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_232351__643.json0.0missingmissingmissing
6474Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_180010__27100.030.51555[128, 511]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_180010__271.json75.0missing{\n "num_gpu": 99\n}missing
6475Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_180109__43400.058.51875[128, 967]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_180109__434.json75.0missing{\n "num_gpu": 99\n}missing
6476Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_000724__98310.024.35581[128, 404]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_000724__983.json60.0missing{\n "num_gpu": 99\n}missing
6477Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231219_232250__28600.07.989630[1, 247]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232250__286.json0.0missingmissingmissing
6478Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_232304__74010.013.56681[1, 408]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_232304__740.json60.0missingmissingmissing
6479Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_175928__37610.010.30575[169, 155]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_175928__376.json80.0missing{\n "num_gpu": 99\n}missing
6480Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_175940__13810.011.51811[169, 176]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_175940__138.json60.0missing{\n "num_gpu": 99\n}missing
6481Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_000659__33210.011.44721[169, 175]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_000659__332.json60.0missing{\n "num_gpu": 99\n}missing
6482Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_232211__21200.014.58910[1, 417]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232211__212.json0.0missingmissingmissing
6483Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_232228__18000.017.70350[1, 499]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_232228__180.json0.0missingmissingmissing
6484Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_175849__79800.037.79770[316, 451]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_175849__798.json0.0missing{\n "num_gpu": 99\n}missing
6485Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_175917__93900.028.52440[316, 443]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_175917__939.json25.0missing{\n "num_gpu": 99\n}missing
6486Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_000647__39800.035.91590[316, 422]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_000647__398.json0.0missing{\n "num_gpu": 99\n}missing
6487Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_232703__11800.013.30890[1, 369]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232703__118.json0.0missingmissingmissing
6488Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_232736__87110.033.13671[1, 854]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_232736__871.json60.0missingmissingmissing
6489Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180317__92410.026.42951[436, 386]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180317__924.json60.0missing{\n "num_gpu": 99\n}missing
6490Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_180339__29910.022.09691[436, 315]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_180339__299.json60.0missing{\n "num_gpu": 99\n}missing
6491Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_000823__38310.029.00121[436, 428]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_000823__383.json60.0missing{\n "num_gpu": 99\n}missing
6492Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_232555__13500.025.69160[1, 680]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232555__135.json0.0missingmissingmissing
6493Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_232629__96110.034.00131[1, 875]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_232629__961.json60.0missingmissingmissing
6494Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180218__94610.022.51021[434, 322]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180218__946.json60.0missing{\n "num_gpu": 99\n}missing
6495Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_180250__96710.031.55111[434, 470]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_180250__967.json60.0missing{\n "num_gpu": 99\n}missing
6496Apple-MacBook-Pro-M1event_schedulersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_000754__77710.029.351[434, 434]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_000754__777.json60.0missing{\n "num_gpu": 99\n}missing
6497Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrAsIs1SHOTfalsefalse520231214_005239__28300.018.70860[107, 534]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_005239__283.json0.0missingmissingmissing
6498Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrAsIs1SHOTfalsefalse520231225_172534__41300.06.205250[123, 331]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_172534__413.json0.0missing{\n "num_gpu": 99\n}missing
6499Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrAsIs1SHOTfalsefalse520231225_172540__83700.05.63910[123, 302]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_172540__837.json0.0missing{\n "num_gpu": 99\n}missing
6500Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTtruetrue520231214_005220__52400.012.97221[124, 371]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_005220__524.json55.0missingmissingmissing
6501Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTfalsefalse520231225_172521__63300.017.71030[126, 904]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_172521__633.json0.0missing{\n "num_gpu": 99\n}missing
6502Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTfalsefalse520231225_172528__39100.07.042110[126, 384]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_172528__391.json0.0missing{\n "num_gpu": 99\n}missing
6503Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrInJulia1SHOTtruefalse520231226_235401__97900.09.678950[126, 528]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__InJulia__1SHOT__20231226_235401__979.json25.0missing{\n "num_gpu": 99\n}missing
6504Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_005207__32910.017.91011[153, 498]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_005207__329.json60.0missingmissingmissing
6505Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_172454__89900.07.026960[163, 359]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_172454__899.json0.0missing{\n "num_gpu": 99\n}missing
6506Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_172503__39000.08.72920[163, 446]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_172503__390.json0.0missing{\n "num_gpu": 99\n}missing
6507Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231226_235351__63800.08.561180[163, 456]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231226_235351__638.json0.0missing{\n "num_gpu": 99\n}missing
6508Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231214_005149__24100.024.92430[300, 618]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005149__241.json0.0missingmissingmissing
6509Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_172440__49000.014.42750[278, 571]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172440__490.json0.0missing{\n "num_gpu": 99\n}missing
6510Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_172447__97000.07.230430[278, 356]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_172447__970.json0.0missing{\n "num_gpu": 99\n}missing
6511Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231226_235342__56900.010.03530[278, 365]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231226_235342__569.json0.0missing{\n "num_gpu": 99\n}missing
6512Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_005329__72200.023.73510[11, 626]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005329__722.json0.0missingmissingmissing
6513Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_172625__86610.010.91921[413, 487]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172625__866.json60.0missing{\n "num_gpu": 99\n}missing
6514Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_172638__55200.012.920[413, 591]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_172638__552.json0.0missing{\n "num_gpu": 99\n}missing
6515Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231226_235422__68410.012.82381[413, 592]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235422__684.json60.0missing{\n "num_gpu": 99\n}missing
6516Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231214_005305__63000.025.79980[424, 582]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_005305__630.json0.0missingmissingmissing
6517Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_172557__13700.017.88890[411, 797]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_172557__137.json50.0missing{\n "num_gpu": 99\n}missing
6518Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_172614__68900.016.74610[411, 755]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_172614__689.json0.0missing{\n "num_gpu": 99\n}missing
6519Apple-MacBook-Pro-M1event_schedulerstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231226_235409__18800.08.307750[411, 375]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231226_235409__188.json25.0missing{\n "num_gpu": 99\n}missing
6520Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestAsIs1SHOTfalsefalse520231214_004256__59500.021.25260[107, 603]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_004256__595.json0.0missingmissingmissing
6521Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestAsIs1SHOTfalsefalse520231225_165832__74600.011.41450[125, 361]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_165832__746.json0.0missing{\n "num_gpu": 99\n}missing
6522Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestAsIs1SHOTfalsefalse520231225_165842__73300.09.94210[125, 313]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_165842__733.json0.0missing{\n "num_gpu": 99\n}missing
6523Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTfalsefalse520231214_004235__58100.015.3220[124, 438]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_004235__581.json0.0missingmissingmissing
6524Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruetrue520231225_165806__66210.016.25061[128, 516]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_165806__662.json60.0missing{\n "num_gpu": 99\n}missing
6525Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruetrue520231225_165820__52000.013.67830[128, 433]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_165820__520.json50.0missing{\n "num_gpu": 99\n}missing
6526Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestInJulia1SHOTtruetrue520231226_234439__14510.012.6051[128, 398]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__InJulia__1SHOT__20231226_234439__145.json60.0missing{\n "num_gpu": 99\n}missing
6527Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_004219__75710.012.471[153, 345]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_004219__757.json60.0missingmissingmissing
6528Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231225_165734__47900.010.43420[169, 318]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_165734__479.json0.0missing{\n "num_gpu": 99\n}missing
6529Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_165749__34210.015.01291[169, 464]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_165749__342.json60.0missing{\n "num_gpu": 99\n}missing
6530Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231226_234426__46610.010.95111[169, 334]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231226_234426__466.json60.0missing{\n "num_gpu": 99\n}missing
6531Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_004207__69900.014.26140[300, 338]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004207__699.json0.0missingmissingmissing
6532Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231225_165705__18700.020.47890[316, 442]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165705__187.json0.0missing{\n "num_gpu": 99\n}missing
6533Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231225_165724__41900.018.33470[316, 542]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_165724__419.json25.0missing{\n "num_gpu": 99\n}missing
6534Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231226_234415__18800.022.96060[316, 522]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234415__188.json25.0missing{\n "num_gpu": 99\n}missing
6535Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231214_004340__48430.021.09815[11, 561]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004340__484.json90.0missingmissingmissing
6536Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_165925__83500.011.3420[436, 300]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165925__835.json50.0missing{\n "num_gpu": 99\n}missing
6537Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_165953__83000.028.19291[436, 807]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_165953__830.json55.0missing{\n "num_gpu": 99\n}missing
6538Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231226_234508__42210.016.50191[436, 457]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231226_234508__422.json60.0missing{\n "num_gpu": 99\n}missing
6539Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231214_004318__62700.022.41850[424, 497]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_004318__627.json0.0missingmissingmissing
6540Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231225_165905__59500.022.68020[434, 645]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_165905__595.json25.0missing{\n "num_gpu": 99\n}missing
6541Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_165913__77100.08.443531[434, 208]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_165913__771.json55.0missing{\n "num_gpu": 99\n}missing
6542Apple-MacBook-Pro-M1event_schedulerstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231226_234452__74710.012.55691[434, 336]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231226_234452__747.json60.0missing{\n "num_gpu": 99\n}missing
6543Apple-MacBook-Pro-M1event_scheduleryi:34b-chatAsIs1SHOTfalsefalse520231214_004450__81000.021.02130[107, 596]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_004450__810.json0.0missingmissingmissing
6544Apple-MacBook-Pro-M1event_scheduleryi:34b-chatAsIs1SHOTtruetrue520231225_170656__68710.054.78491[120, 405]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_170656__687.json60.0missing{\n "num_gpu": 99\n}missing
6545Apple-MacBook-Pro-M1event_scheduleryi:34b-chatAsIs1SHOTtruefalse520231225_170808__85600.070.90310[120, 529]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_170808__856.json25.0missing{\n "num_gpu": 99\n}missing
6546Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruetrue520231214_004429__41210.019.9041[124, 564]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_004429__412.json60.0missingmissingmissing
6547Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruetrue520231225_170458__55200.079.6450[123, 594]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_170458__552.json50.0missing{\n "num_gpu": 99\n}missing
6548Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruefalse520231225_170601__54800.063.33820[123, 468]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_170601__548.json25.0missing{\n "num_gpu": 99\n}missing
6549Apple-MacBook-Pro-M1event_scheduleryi:34b-chatInJulia1SHOTtruefalse520231226_234907__46900.0100.9920[123, 748]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__InJulia__1SHOT__20231226_234907__469.json25.0missing{\n "num_gpu": 99\n}missing
6550Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_004409__67910.09.866231[153, 269]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_004409__679.json60.0missingmissingmissing
6551Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_170243__64910.041.67041[162, 296]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_170243__649.json60.0missing{\n "num_gpu": 99\n}missing
6552Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_170338__43900.053.60460[162, 387]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_170338__439.json25.0missing{\n "num_gpu": 99\n}missing
6553Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231226_234726__46500.040.10880[162, 283]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231226_234726__465.json50.0missing{\n "num_gpu": 99\n}missing
6554Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231214_004358__96900.018.71590[300, 457]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_004358__969.json25.0missingmissingmissing
6555Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_170100__81810.066.61791[313, 280]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_170100__818.json60.0missing{\n "num_gpu": 99\n}missing
6556Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_170202__34600.061.03140[313, 415]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_170202__346.json25.0missing{\n "num_gpu": 99\n}missing
6557Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231226_234646__68200.097.38720[313, 516]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231226_234646__682.json25.0missing{\n "num_gpu": 99\n}missing
6558Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_004536__18710.019.66261[11, 525]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_004536__187.json60.0missingmissingmissing
6559Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_171229__90800.085.79120[436, 568]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171229__908.json50.0missing{\n "num_gpu": 99\n}missing
6560Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231225_171238__68000.09.691640[436, 4]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_171238__680.json0.0missing{\n "num_gpu": 99\n}missing
6561Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231226_235029__20400.016.74110[436, 58]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231226_235029__204.json0.0missing{\n "num_gpu": 99\n}missing
6562Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTfalsefalse520231214_004516__99300.026.39580[424, 597]0.10.0-DEV51.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_004516__993.json0.0missingmissingmissing
6563Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_170951__78600.0102.1850[434, 684]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_170951__786.json25.0missing{\n "num_gpu": 99\n}missing
6564Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_171103__56500.071.47980[434, 465]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_171103__565.json25.0missing{\n "num_gpu": 99\n}missing
6565Apple-MacBook-Pro-M1event_scheduleryi:34b-chatJuliaRecapTask1SHOTtruetrue520231226_235012__99100.063.9850[434, 410]0.10.0-DEV51.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/event_scheduler/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231226_235012__991.json50.0missing{\n "num_gpu": 99\n}missing
6566Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructAsIs1SHOTfalsefalse520231214_010951__11600.037.78450[72, 297]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_010951__116.json0.0missingmissingmissing
6567Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructAsIs1SHOTfalsefalse520231225_142526__90300.09.120340[94, 160]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_142526__903.json0.0missing{\n "num_gpu": 99\n}missing
6568Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructAsIs1SHOTtruefalse520231225_142536__33900.09.217410[94, 162]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_142536__339.json25.0missing{\n "num_gpu": 99\n}missing
6569Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTtruetrue520231214_010913__67400.067.72510[89, 548]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_010913__674.json50.0missingmissingmissing
6570Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTtruetrue520231225_142511__73200.023.3150[97, 423]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_142511__732.json50.0missing{\n "num_gpu": 99\n}missing
6571Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTfalsefalse520231225_142517__95000.06.38990[97, 104]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_142517__950.json0.0missing{\n "num_gpu": 99\n}missing
6572Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructInJulia1SHOTtruetrue520231227_002344__28410.05.809491[97, 92]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_002344__284.json61.25missing{\n "num_gpu": 99\n}missing
6573Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231214_010805__24000.047.7980[118, 377]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_010805__240.json0.0missingmissingmissing
6574Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_142442__21700.014.88070[135, 260]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_142442__217.json50.0missing{\n "num_gpu": 99\n}missing
6575Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_142447__65600.05.025710[135, 72]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_142447__656.json0.0missing{\n "num_gpu": 99\n}missing
6576Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_002339__11810.06.113571[135, 93]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_002339__118.json61.25missing{\n "num_gpu": 99\n}missing
6577Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231214_010717__58700.065.15380[211, 509]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_010717__587.json50.0missingmissingmissing
6578Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_142413__16700.025.20161[229, 253]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142413__167.json56.25missing{\n "num_gpu": 99\n}missing
6579Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_142427__66010.014.56921[229, 236]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142427__660.json61.25missing{\n "num_gpu": 99\n}missing
6580Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_002332__86500.024.81741[229, 252]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002332__865.json56.25missing{\n "num_gpu": 99\n}missing
6581Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_011155__64100.060.49120[11, 467]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_011155__641.json50.0missingmissingmissing
6582Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_142631__76910.016.54861[400, 242]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142631__769.json61.25missing{\n "num_gpu": 99\n}missing
6583Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_142649__48710.018.03841[400, 269]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142649__487.json61.25missing{\n "num_gpu": 99\n}missing
6584Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231227_002426__77600.016.970[400, 245]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002426__776.json25.0missing{\n "num_gpu": 99\n}missing
6585Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_011055__71200.064.15340[389, 404]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_011055__712.json0.0missingmissingmissing
6586Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_142558__83810.022.23022[397, 344]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_142558__838.json67.5missing{\n "num_gpu": 99\n}missing
6587Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_142614__30800.016.55940[397, 243]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_142614__308.json50.0missing{\n "num_gpu": 99\n}missing
6588Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_002408__25400.023.12660[397, 358]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_002408__254.json50.0missing{\n "num_gpu": 99\n}missing
6589NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011614__36500.01.83670[0, 138]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011614__365.json50.0missing{\n "num_gpu": 99\n}missing
6590NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011617__41100.02.349450[0, 179]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011617__411.json50.0missing{\n "num_gpu": 99\n}missing
6591NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011620__70510.03.028111[0, 230]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011620__705.json61.25missing{\n "num_gpu": 99\n}missing
6592NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011625__49800.04.844550[0, 367]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011625__498.json50.0missing{\n "num_gpu": 99\n}missing
6593NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011629__50610.04.183921[0, 318]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011629__506.json61.25missing{\n "num_gpu": 99\n}missing
6594NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_011553__47400.03.728630[0, 270]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011553__474.json0.0missing{\n "num_gpu": 99\n}missing
6595NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_011556__60300.03.479750[0, 252]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011556__603.json25.0missing{\n "num_gpu": 99\n}missing
6596NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_011558__93110.01.727671[0, 126]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011558__931.json61.25missing{\n "num_gpu": 99\n}missing
6597NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_011600__33900.02.269550[0, 169]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011600__339.json0.0missing{\n "num_gpu": 99\n}missing
6598NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_011601__97800.01.026540[0, 78]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011601__978.json25.0missing{\n "num_gpu": 99\n}missing
6599NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_011530__27510.03.46931[0, 249]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011530__275.json61.25missing{\n "num_gpu": 99\n}missing
6600NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_011531__39710.01.745481[0, 126]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011531__397.json61.25missing{\n "num_gpu": 99\n}missing
6601NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_011533__27500.01.447280[0, 104]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011533__275.json0.0missing{\n "num_gpu": 99\n}missing
6602NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_011540__58110.06.773682[0, 481]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011540__581.json67.5missing{\n "num_gpu": 99\n}missing
6603NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_011542__42600.02.221060[0, 160]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011542__426.json50.0missing{\n "num_gpu": 99\n}missing
6604NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_011738__65300.04.486230[0, 331]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011738__653.json50.0missing{\n "num_gpu": 99\n}missing
6605NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_011741__78400.02.683990[0, 193]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011741__784.json0.0missing{\n "num_gpu": 99\n}missing
6606NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_011746__19800.04.76570[0, 343]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011746__198.json25.0missing{\n "num_gpu": 99\n}missing
6607NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_011750__38200.04.062560[0, 293]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011750__382.json50.0missing{\n "num_gpu": 99\n}missing
6608NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_011752__21400.01.838160[0, 133]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011752__214.json0.0missing{\n "num_gpu": 99\n}missing
6609NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011655__21810.03.736571[0, 276]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011655__218.json61.25missing{\n "num_gpu": 99\n}missing
6610NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011658__84500.02.975911[0, 215]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011658__845.json56.25missing{\n "num_gpu": 99\n}missing
6611NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011703__66100.05.160150[0, 377]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011703__661.json50.0missing{\n "num_gpu": 99\n}missing
6612NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011705__16500.01.775230[0, 131]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011705__165.json50.0missing{\n "num_gpu": 99\n}missing
6613NVIDIA-RTX-4090-4xextract_julia_codecodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_011707__94200.01.516730[0, 112]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011707__942.json0.0missing{\n "num_gpu": 99\n}missing
6614Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonAsIs1SHOTfalsefalse520231214_072123__33800.022042.70[72, 442]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_072123__338.json0.0missingmissingmissing
6615Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonAsIs1SHOTtruetrue520231225_142820__93000.07.6380[68, 133]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_142820__930.json50.0missing{\n "num_gpu": 99\n}missing
6616Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonAsIs1SHOTtruetrue520231225_142831__22000.011.13610[68, 200]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_142831__220.json50.0missing{\n "num_gpu": 99\n}missing
6617Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonInJulia1SHOTtruetrue520231214_011400__81900.053.65480[89, 451]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_011400__819.json50.0missingmissingmissing
6618Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonInJulia1SHOTfalsefalse520231225_142804__56600.01.564770[71, 15]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_142804__566.json0.0missing{\n "num_gpu": 99\n}missing
6619Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonInJulia1SHOTtruetrue520231225_142813__39100.08.786280[71, 155]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_142813__391.json50.0missing{\n "num_gpu": 99\n}missing
6620Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_011307__95900.020.1570[118, 167]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_011307__959.json0.0missingmissingmissing
6621Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231225_142740__62200.027.4330[72, 504]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_142740__622.json50.0missing{\n "num_gpu": 99\n}missing
6622Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231225_142802__15800.021.67670[72, 399]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_142802__158.json50.0missing{\n "num_gpu": 99\n}missing
6623Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_011246__43000.051.04050[211, 406]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_011246__430.json50.0missingmissingmissing
6624Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_142705__96200.015.55590[104, 88]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142705__962.json0.0missing{\n "num_gpu": 99\n}missing
6625Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_142713__19400.07.958930[104, 134]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142713__194.json0.0missing{\n "num_gpu": 99\n}missing
6626Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231214_072324__71200.010.38020[11, 61]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_072324__712.json0.0missingmissingmissing
6627Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_142911__22300.012.47440[89, 225]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142911__223.json0.0missing{\n "num_gpu": 99\n}missing
6628Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_142912__46300.01.373460[89, 11]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142912__463.json0.0missing{\n "num_gpu": 99\n}missing
6629Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_072313__14500.0109.1140[389, 538]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_072313__145.json0.0missingmissingmissing
6630Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231225_142841__17500.09.802120[86, 174]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_142841__175.json50.0missing{\n "num_gpu": 99\n}missing
6631Apple-MacBook-Pro-M1extract_julia_codecodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_142858__69200.016.63490[86, 304]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_142858__692.json25.0missing{\n "num_gpu": 99\n}missing
6632NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_012156__90810.03.052191[0, 110]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_012156__908.json61.25missing{\n "num_gpu": 99\n}missing
6633NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_012201__90910.04.135471[0, 149]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_012201__909.json61.25missing{\n "num_gpu": 99\n}missing
6634NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_012208__55410.06.94391[0, 250]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_012208__554.json61.25missing{\n "num_gpu": 99\n}missing
6635NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_012212__73700.03.539340[0, 128]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_012212__737.json50.0missing{\n "num_gpu": 99\n}missing
6636NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_012219__51600.07.539320[0, 271]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_012219__516.json25.0missing{\n "num_gpu": 99\n}missing
6637NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012058__17210.05.649191[0, 201]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012058__172.json61.25missing{\n "num_gpu": 99\n}missing
6638NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012105__38510.07.698011[0, 274]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012105__385.json61.25missing{\n "num_gpu": 99\n}missing
6639NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012110__70000.04.292230[0, 153]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012110__700.json50.0missing{\n "num_gpu": 99\n}missing
6640NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012117__74410.06.657841[0, 237]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012117__744.json61.25missing{\n "num_gpu": 99\n}missing
6641NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012123__82110.06.283292[0, 226]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012123__821.json67.5missing{\n "num_gpu": 99\n}missing
6642NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_012021__63110.03.217481[0, 116]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012021__631.json61.25missing{\n "num_gpu": 99\n}missing
6643NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012023__99800.01.99630[0, 72]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012023__998.json0.0missing{\n "num_gpu": 99\n}missing
6644NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012026__83100.02.966920[0, 107]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012026__831.json0.0missing{\n "num_gpu": 99\n}missing
6645NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012029__74400.02.217980[0, 80]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012029__744.json0.0missing{\n "num_gpu": 99\n}missing
6646NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012031__78000.02.024290[0, 73]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012031__780.json0.0missing{\n "num_gpu": 99\n}missing
6647NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_012348__11300.012.53870[0, 444]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_012348__113.json50.0missing{\n "num_gpu": 99\n}missing
6648NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_012354__28310.06.271312[0, 223]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_012354__283.json67.5missing{\n "num_gpu": 99\n}missing
6649NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_012410__13710.016.25482[0, 575]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_012410__137.json67.5missing{\n "num_gpu": 99\n}missing
6650NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_012415__89700.04.798310[0, 170]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_012415__897.json0.0missing{\n "num_gpu": 99\n}missing
6651NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_012426__62800.010.63260[0, 375]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_012426__628.json50.0missing{\n "num_gpu": 99\n}missing
6652NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_012246__76510.05.048111[0, 180]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_012246__765.json61.25missing{\n "num_gpu": 99\n}missing
6653NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_012252__83100.06.212640[0, 221]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_012252__831.json25.0missing{\n "num_gpu": 99\n}missing
6654NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_012255__20800.02.575520[0, 92]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_012255__208.json0.0missing{\n "num_gpu": 99\n}missing
6655NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_012303__70700.08.08220[0, 287]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_012303__707.json0.0missing{\n "num_gpu": 99\n}missing
6656NVIDIA-RTX-4090-4xextract_julia_codecodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_012305__98500.02.516530[0, 90]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_012305__985.json50.0missing{\n "num_gpu": 99\n}missing
6657NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_011202__16400.04.489820[0, 109]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_011202__164.json0.0missing{\n "num_gpu": 99\n}missing
6658NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_011210__56600.08.374380[0, 203]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_011210__566.json0.0missing{\n "num_gpu": 99\n}missing
6659NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_011233__19600.023.47440[0, 566]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_011233__196.json0.0missing{\n "num_gpu": 99\n}missing
6660NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_011237__86400.03.248210[0, 80]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_011237__864.json0.0missing{\n "num_gpu": 99\n}missing
6661NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_011241__44900.03.844430[0, 94]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_011241__449.json0.0missing{\n "num_gpu": 99\n}missing
6662NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_011039__22100.07.712430[0, 187]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_011039__221.json0.0missing{\n "num_gpu": 99\n}missing
6663NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_011050__30400.011.27850[0, 273]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_011050__304.json0.0missing{\n "num_gpu": 99\n}missing
6664NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_011101__82500.011.18390[0, 271]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_011101__825.json0.0missing{\n "num_gpu": 99\n}missing
6665NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_011110__82000.08.488660[0, 206]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_011110__820.json0.0missing{\n "num_gpu": 99\n}missing
6666NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_011115__67400.05.483120[0, 133]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_011115__674.json0.0missing{\n "num_gpu": 99\n}missing
6667NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_010948__38900.00.124690[0, 3]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_010948__389.json0.0missing{\n "num_gpu": 99\n}missing
6668NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_010948__49700.00.1257250[0, 3]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_010948__497.json0.0missing{\n "num_gpu": 99\n}missing
6669NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_010948__52300.00.1247990[0, 3]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_010948__523.json0.0missing{\n "num_gpu": 99\n}missing
6670NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_010948__52800.00.1248630[0, 3]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_010948__528.json0.0missing{\n "num_gpu": 99\n}missing
6671NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_010948__56500.00.1247120[0, 3]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_010948__565.json0.0missing{\n "num_gpu": 99\n}missing
6672NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_011441__40800.01.516970[0, 37]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011441__408.json0.0missing{\n "num_gpu": 99\n}missing
6673NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_011448__65600.07.090160[0, 172]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011448__656.json0.0missing{\n "num_gpu": 99\n}missing
6674NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_011459__80500.010.91770[0, 264]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011459__805.json0.0missing{\n "num_gpu": 99\n}missing
6675NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_011501__90200.01.765820[0, 43]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011501__902.json0.0missing{\n "num_gpu": 99\n}missing
6676NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_011507__60200.06.467590[0, 157]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011507__602.json50.0missing{\n "num_gpu": 99\n}missing
6677NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_011328__72600.08.466960[0, 205]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_011328__726.json0.0missing{\n "num_gpu": 99\n}missing
6678NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_011334__21400.06.04840[0, 147]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_011334__214.json0.0missing{\n "num_gpu": 99\n}missing
6679NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_011340__82700.06.12830[0, 149]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_011340__827.json0.0missing{\n "num_gpu": 99\n}missing
6680NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_011345__20300.04.8160[0, 117]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_011345__203.json0.0missing{\n "num_gpu": 99\n}missing
6681NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_011353__37400.07.870390[0, 191]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_011353__374.json0.0missing{\n "num_gpu": 99\n}missing
6682NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_010248__35400.03.360220[0, 63]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_010248__354.json0.0missing{\n "num_gpu": 99\n}missing
6683NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_010305__64300.016.94590[0, 317]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_010305__643.json50.0missing{\n "num_gpu": 99\n}missing
6684NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_010322__45800.017.58530[0, 329]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_010322__458.json50.0missing{\n "num_gpu": 99\n}missing
6685NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_010336__74600.013.55660[0, 254]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_010336__746.json0.0missing{\n "num_gpu": 99\n}missing
6686NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_010356__62900.020.31990[0, 380]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_010356__629.json0.0missing{\n "num_gpu": 99\n}missing
6687NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_010053__19300.015.97440[0, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_010053__193.json0.0missing{\n "num_gpu": 99\n}missing
6688NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_010101__16400.07.986180[0, 148]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_010101__164.json0.0missing{\n "num_gpu": 99\n}missing
6689NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_010111__40700.09.75290[0, 181]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_010111__407.json0.0missing{\n "num_gpu": 99\n}missing
6690NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_010123__55000.011.71510[0, 219]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_010123__550.json0.0missing{\n "num_gpu": 99\n}missing
6691NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_010153__95310.030.16152[0, 552]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_010153__953.json67.5missing{\n "num_gpu": 99\n}missing
6692NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_005824__14500.013.78660[0, 257]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_005824__145.json0.0missing{\n "num_gpu": 99\n}missing
6693NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_005851__60500.027.34940[0, 507]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_005851__605.json0.0missing{\n "num_gpu": 99\n}missing
6694NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_005855__53200.04.068740[0, 76]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_005855__532.json0.0missing{\n "num_gpu": 99\n}missing
6695NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_005909__64700.014.01910[0, 261]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_005909__647.json0.0missing{\n "num_gpu": 99\n}missing
6696NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_005921__92300.012.28050[0, 229]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_005921__923.json0.0missing{\n "num_gpu": 99\n}missing
6697NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_010810__73100.05.350630[0, 99]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_010810__731.json0.0missing{\n "num_gpu": 99\n}missing
6698NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_010820__68300.010.25740[0, 190]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_010820__683.json0.0missing{\n "num_gpu": 99\n}missing
6699NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_010835__20800.014.15460[0, 260]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_010835__208.json0.0missing{\n "num_gpu": 99\n}missing
6700NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_010845__75700.010.48280[0, 192]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_010845__757.json0.0missing{\n "num_gpu": 99\n}missing
6701NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_010900__48300.015.3210[0, 281]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_010900__483.json0.0missing{\n "num_gpu": 99\n}missing
6702NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_010530__47810.019.15061[0, 354]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_010530__478.json61.25missing{\n "num_gpu": 99\n}missing
6703NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_010604__30700.033.19940[0, 611]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_010604__307.json0.0missing{\n "num_gpu": 99\n}missing
6704NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_010635__18700.031.53860[0, 578]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_010635__187.json50.0missing{\n "num_gpu": 99\n}missing
6705NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_010638__91100.03.205870[0, 59]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_010638__911.json0.0missing{\n "num_gpu": 99\n}missing
6706NVIDIA-RTX-4090-4xextract_julia_codecodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_010653__53600.014.86140[0, 272]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_010653__536.json0.0missing{\n "num_gpu": 99\n}missing
6707NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011834__78410.01.376582[0, 167]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011834__784.json67.5missing{\n "num_gpu": 99\n}missing
6708NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011837__93910.02.853621[0, 345]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011837__939.json61.25missing{\n "num_gpu": 99\n}missing
6709NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_011839__70100.02.155040[0, 261]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011839__701.json50.0missing{\n "num_gpu": 99\n}missing
6710NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_011841__27900.02.006670[0, 243]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011841__279.json0.0missing{\n "num_gpu": 99\n}missing
6711NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_011844__27400.02.318740[0, 281]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_011844__274.json0.0missing{\n "num_gpu": 99\n}missing
6712NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_011817__84500.00.5950440[0, 72]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011817__845.json0.0missing{\n "num_gpu": 99\n}missing
6713NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_011819__95700.01.927580[0, 223]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011819__957.json0.0missing{\n "num_gpu": 99\n}missing
6714NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_011820__36200.01.252890[0, 147]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011820__362.json0.0missing{\n "num_gpu": 99\n}missing
6715NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_011822__47510.01.688972[0, 198]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011822__475.json67.5missing{\n "num_gpu": 99\n}missing
6716NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_011823__96600.01.160580[0, 135]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_011823__966.json0.0missing{\n "num_gpu": 99\n}missing
6717NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_011802__74700.00.7118580[0, 86]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011802__747.json0.0missing{\n "num_gpu": 99\n}missing
6718NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_011803__13300.01.350260[0, 163]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011803__133.json50.0missing{\n "num_gpu": 99\n}missing
6719NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_011805__13900.01.212160[0, 144]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011805__139.json0.0missing{\n "num_gpu": 99\n}missing
6720NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_011805__40600.00.7029930[0, 85]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011805__406.json0.0missing{\n "num_gpu": 99\n}missing
6721NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_011806__80300.00.701980[0, 85]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_011806__803.json0.0missing{\n "num_gpu": 99\n}missing
6722NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_011931__37400.02.239620[0, 264]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011931__374.json50.0missing{\n "num_gpu": 99\n}missing
6723NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_011935__65800.02.737180[0, 322]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011935__658.json50.0missing{\n "num_gpu": 99\n}missing
6724NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_011936__66300.01.559410[0, 185]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011936__663.json25.0missing{\n "num_gpu": 99\n}missing
6725NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_011938__38500.01.950640[0, 231]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011938__385.json0.0missing{\n "num_gpu": 99\n}missing
6726NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_011939__79900.01.168550[0, 139]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_011939__799.json0.0missing{\n "num_gpu": 99\n}missing
6727NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011858__42610.01.505921[0, 179]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011858__426.json61.25missing{\n "num_gpu": 99\n}missing
6728NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_011900__66900.01.832160[0, 217]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011900__669.json0.0missing{\n "num_gpu": 99\n}missing
6729NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011902__90200.02.189470[0, 259]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011902__902.json50.0missing{\n "num_gpu": 99\n}missing
6730NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011905__36200.02.771750[0, 325]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011905__362.json50.0missing{\n "num_gpu": 99\n}missing
6731NVIDIA-RTX-4090-4xextract_julia_codecodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_011909__10000.03.436821[0, 405]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_011909__100.json56.25missing{\n "num_gpu": 99\n}missing
6732Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_234725__65300.017.63130[72, 518]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_234725__653.json0.0missingmissingmissing
6733Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_234738__52100.012.9840[1, 401]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_234738__521.json0.0missingmissingmissing
6734Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231219_234752__50000.013.94340[1, 429]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231219_234752__500.json0.0missingmissingmissing
6735Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_145012__10300.038.99570[87, 233]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_145012__103.json0.0missing{\n "num_gpu": 99\n}missing
6736Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_145056__19500.043.98040[87, 264]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_145056__195.json0.0missing{\n "num_gpu": 99\n}missing
6737Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231219_234655__12500.010.68740[1, 334]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_234655__125.json0.0missingmissingmissing
6738Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231219_234708__15600.012.05750[1, 374]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231219_234708__156.json25.0missingmissingmissing
6739Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_144900__23110.045.43291[90, 273]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_144900__231.json61.25missing{\n "num_gpu": 99\n}missing
6740Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_144932__86210.030.72551[90, 177]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_144932__862.json61.25missing{\n "num_gpu": 99\n}missing
6741Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_003537__64700.043.3821[90, 257]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_003537__647.json56.25missing{\n "num_gpu": 99\n}missing
6742Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_234623__11400.02.240220[1, 72]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_234623__114.json25.0missingmissingmissing
6743Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_234632__48400.08.79940[1, 274]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_234632__484.json50.0missingmissingmissing
6744Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_144724__47510.071.51431[131, 424]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_144724__475.json61.25missing{\n "num_gpu": 99\n}missing
6745Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_144815__75100.049.88380[131, 291]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_144815__751.json50.0missing{\n "num_gpu": 99\n}missing
6746Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_003453__64100.0140.3340[131, 810]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_003453__641.json50.0missing{\n "num_gpu": 99\n}missing
6747Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_234607__69600.04.358720[1, 134]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234607__696.json0.0missingmissingmissing
6748Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_234613__53600.05.984660[1, 183]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234613__536.json0.0missingmissingmissing
6749Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_144536__79500.057.07532[224, 161]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_144536__795.json62.5missing{\n "num_gpu": 99\n}missing
6750Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_144612__85510.036.08451[224, 193]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_144612__855.json61.25missing{\n "num_gpu": 99\n}missing
6751Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_003233__64800.044.86470[224, 97]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_003233__648.json0.0missing{\n "num_gpu": 99\n}missing
6752Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_234852__27400.020.42520[1, 557]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234852__274.json0.0missingmissingmissing
6753Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_234914__49100.022.08670[1, 598]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_234914__491.json0.0missingmissingmissing
6754Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145305__69110.074.00362[419, 385]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145305__691.json67.5missing{\n "num_gpu": 99\n}missing
6755Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145349__15400.043.56321[419, 202]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145349__154.json56.25missing{\n "num_gpu": 99\n}missing
6756Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_003731__36410.065.61172[419, 329]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003731__364.json67.5missing{\n "num_gpu": 99\n}missing
6757Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_234817__53800.01.222610[1, 36]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_234817__538.json0.0missingmissingmissing
6758Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_234829__10500.011.98020[1, 338]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_234829__105.json50.0missingmissingmissing
6759Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145129__67310.033.29352[417, 140]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145129__673.json67.5missing{\n "num_gpu": 99\n}missing
6760Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145150__89210.020.80681[417, 63]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145150__892.json61.25missing{\n "num_gpu": 99\n}missing
6761Apple-MacBook-Pro-M1extract_julia_codedeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_003625__31310.047.39122[417, 225]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_003625__313.json67.5missing{\n "num_gpu": 99\n}missing
6762Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_004318__97100.012.97470[89, 494]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_004318__971.json0.0missing{\n "num_gpu": 99\n}missing
6763Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_114514__28200.010.17740[89, 390]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_114514__282.json0.0missing{\n "num_gpu": 99\n}missing
6764Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_114528__20900.014.34810[89, 544]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_114528__209.json0.0missing{\n "num_gpu": 99\n}missing
6765Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_114541__75700.012.69670[89, 484]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_114541__757.json25.0missing{\n "num_gpu": 99\n}missing
6766Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_004305__87300.03.260130[126, 117]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_004305__873.json0.0missing{\n "num_gpu": 99\n}missing
6767Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_114450__99300.05.016290[126, 186]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_114450__993.json0.0missing{\n "num_gpu": 99\n}missing
6768Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_114456__50800.05.932230[126, 222]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_114456__508.json0.0missing{\n "num_gpu": 99\n}missing
6769Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_114503__28800.07.125820[126, 268]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_114503__288.json0.0missing{\n "num_gpu": 99\n}missing
6770Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_004302__54900.05.460640[217, 58]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004302__549.json25.0missing{\n "num_gpu": 99\n}missing
6771Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_114437__14600.07.8380[217, 146]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114437__146.json0.0missing{\n "num_gpu": 99\n}missing
6772Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_114442__48200.05.424680[217, 187]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114442__482.json50.0missing{\n "num_gpu": 99\n}missing
6773Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_114445__88200.03.199490[217, 101]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114445__882.json50.0missing{\n "num_gpu": 99\n}missing
6774Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_004331__11600.07.031820[378, 219]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004331__116.json0.0missing{\n "num_gpu": 99\n}missing
6775Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_114621__29000.08.3970[378, 269]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114621__290.json0.0missing{\n "num_gpu": 99\n}missing
6776Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_114628__93600.06.573760[378, 202]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114628__936.json50.0missing{\n "num_gpu": 99\n}missing
6777Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_114638__37400.09.704750[378, 316]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_114638__374.json0.0missing{\n "num_gpu": 99\n}missing
6778Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_004324__75000.05.654240[375, 168]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_004324__750.json0.0missing{\n "num_gpu": 99\n}missing
6779Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_114551__41800.09.97770[375, 326]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_114551__418.json50.0missing{\n "num_gpu": 99\n}missing
6780Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_114600__15700.09.196910[375, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_114600__157.json0.0missing{\n "num_gpu": 99\n}missing
6781Apple-MacBook-Pro-M1extract_julia_codedolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_114613__59800.012.94810[375, 432]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_114613__598.json0.0missing{\n "num_gpu": 99\n}missing
6782Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_110604__50100.02.064350[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110604__501.json25.0missingmissingmissing
6783Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_110607__50300.02.959790[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110607__503.json0.0missingmissingmissing
6784Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_110609__90800.02.531880[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110609__908.json50.0missingmissingmissing
6785Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_110612__89800.02.808070[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110612__898.json25.0missingmissingmissing
6786Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_110616__45300.04.183860[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110616__453.json0.0missingmissingmissing
6787Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110531__86110.01.822512[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110531__861.json67.5missingmissingmissing
6788Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110534__92500.02.70880[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110534__925.json50.0missingmissingmissing
6789Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_110536__62100.02.129440[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110536__621.json50.0missingmissingmissing
6790Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_110543__64300.06.283920[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110543__643.json0.0missingmissingmissing
6791Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_113827__50500.02.246050[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_113827__505.json0.0missingmissingmissing
6792Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110500__89300.05.443960[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110500__893.json50.0missingmissingmissing
6793Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110503__68500.03.144450[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110503__685.json50.0missingmissingmissing
6794Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110506__64200.02.48130[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110506__642.json50.0missingmissingmissing
6795Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_110513__83000.07.014220[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110513__830.json0.0missingmissingmissing
6796Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_110515__68500.01.999670[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110515__685.json50.0missingmissingmissing
6797Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110714__94400.07.267570[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110714__944.json50.0missingmissingmissing
6798Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110719__56600.04.784720[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110719__566.json50.0missingmissingmissing
6799Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110721__43900.01.814110[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110721__439.json50.0missingmissingmissing
6800Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110726__51400.04.821670[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110726__514.json50.0missingmissingmissing
6801Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_110728__35900.02.056350[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_110728__359.json50.0missingmissingmissing
6802Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110639__41000.02.050780[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110639__410.json50.0missingmissingmissing
6803Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110643__42110.04.762852[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110643__421.json67.5missingmissingmissing
6804Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_110647__70200.03.19490[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110647__702.json25.0missingmissingmissing
6805Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110649__37300.02.085290[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110649__373.json50.0missingmissingmissing
6806Apple-MacBook-Pro-M1extract_julia_codegemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_110651__20900.02.284680[0, 0]0.13.0-DEV41.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110651__209.json50.0missingmissingmissing
6807Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_231458__47500.09.681190[0, 149]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_231458__475.json0.0missingmissingmissing
6808Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_231507__77600.08.98750[0, 134]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_231507__776.json25.0missingmissingmissing
6809Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_231513__45900.05.932470[0, 93]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_231513__459.json25.0missingmissingmissing
6810Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_231522__92600.09.773330[0, 149]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_231522__926.json0.0missingmissingmissing
6811Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_231532__26500.09.087520[0, 139]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_231532__265.json50.0missingmissingmissing
6812Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_231344__76600.02.345160[0, 37]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_231344__766.json50.0missingmissingmissing
6813Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_231346__14800.02.237120[0, 35]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_231346__148.json0.0missingmissingmissing
6814Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_231350__23400.03.754852[0, 58]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_231350__234.json62.5missingmissingmissing
6815Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_231352__56200.02.488220[0, 38]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_231352__562.json50.0missingmissingmissing
6816Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_231406__94700.013.35832[0, 203]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_231406__947.json62.5missingmissingmissing
6817Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_231237__61900.010.8810[0, 164]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_231237__619.json0.0missingmissingmissing
6818Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_231247__33510.010.58962[0, 162]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_231247__335.json67.5missingmissingmissing
6819Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_231256__28000.08.618570[0, 131]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_231256__280.json0.0missingmissingmissing
6820Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_231307__13500.011.1860[0, 168]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_231307__135.json50.0missingmissingmissing
6821Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_231327__17300.019.64040[0, 302]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_231327__173.json0.0missingmissingmissing
6822Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_231941__98400.017.70670[0, 268]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_231941__984.json50.0missingmissingmissing
6823Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_232000__95500.018.53520[0, 280]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_232000__955.json50.0missingmissingmissing
6824Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_232018__33300.018.05860[0, 274]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_232018__333.json50.0missingmissingmissing
6825Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_232038__39300.019.54190[0, 295]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_232038__393.json50.0missingmissingmissing
6826Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_232054__12000.016.3330[0, 247]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_232054__120.json50.0missingmissingmissing
6827Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_231658__96600.016.27220[0, 247]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_231658__966.json50.0missingmissingmissing
6828Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_231715__57300.016.78880[0, 255]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_231715__573.json0.0missingmissingmissing
6829Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_231727__47400.011.86160[0, 179]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_231727__474.json50.0missingmissingmissing
6830Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_231744__97900.017.52710[0, 265]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_231744__979.json0.0missingmissingmissing
6831Apple-MacBook-Pro-M1extract_julia_codegemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_231803__71700.019.03970[0, 288]0.13.0-DEV41.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_231803__717.json0.0missingmissingmissing
6832Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboAsIs1SHOTtruetrue520231213_201931__15200.0004836.456690[78, 296]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_201931__152.json50.0missingmissingmissing
6833Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboAsIs1SHOTtruetrue520231225_192523__78100.0002312.185060[78, 128]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_192523__781.json50.0missingmissingmissing
6834Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboAsIs1SHOTtruetrue520231225_192524__14500.0001231.248630[78, 56]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_192524__145.json50.0missingmissingmissing
6835Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo--optimAsIs1SHOTtruetrue520231215_194217__96000.04.113750[78, 177]0.10.0-DEV41.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_194217__960.json50.00.5missing0.5
6836Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboInJulia1SHOTtruetrue520231213_201925__77810.0002793.529341[81, 159]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_201925__778.json61.25missingmissingmissing
6837Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboInJulia1SHOTtruetrue520231225_192518__59800.0002372.708460[81, 131]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_192518__598.json50.0missingmissingmissing
6838Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboInJulia1SHOTtruetrue520231225_192520__48810.0002612.507851[81, 147]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_192520__488.json61.25missingmissingmissing
6839Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboInJulia1SHOTtruetrue520231227_200043__18610.0004445.033522[81, 269]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_200043__186.json67.5missingmissingmissing
6840Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboInJulia1SHOTfalsefalse520231227_200048__28900.00042454.633350[81, 256]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_200048__289.json0.0missingmissingmissing
6841Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_194213__99500.02.71520[81, 131]0.10.0-DEV41.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_194213__995.json50.00.5missing0.5
6842Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_201921__63210.00016151.85941[116, 69]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_201921__632.json61.25missingmissingmissing
6843Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_192513__82300.00015851.532130[116, 67]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_192513__823.json50.0missingmissingmissing
6844Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_192515__77600.0001931.892062[116, 90]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_192515__776.json62.5missingmissingmissing
6845Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_200036__73900.0001451.760920[116, 58]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_200036__739.json50.0missingmissingmissing
6846Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_200038__95710.00017051.682382[116, 75]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_200038__957.json67.5missingmissingmissing
6847Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_194210__45400.01.577190[116, 52]0.10.0-DEV41.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_194210__454.json50.00.5missing0.5
6848Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231213_201919__47100.0002272.66791[190, 88]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201919__471.json56.25missingmissingmissing
6849Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_192510__31100.0002031.715670[190, 72]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192510__311.json50.0missingmissingmissing
6850Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_192511__73800.0001671.322410[190, 48]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192511__738.json50.0missingmissingmissing
6851Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_200032__81500.0002812.392960[190, 124]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200032__815.json50.0missingmissingmissing
6852Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_200034__91510.0001821.395541[190, 58]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200034__915.json61.25missingmissingmissing
6853Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTtruetrue520231215_194208__88200.01.473760[190, 50]0.10.0-DEV41.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194208__882.json50.00.5missing0.5
6854Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231213_201944__72700.0005045.347570[339, 223]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201944__727.json50.0missingmissingmissing
6855Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_192531__45400.00040652.557560[339, 158]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192531__454.json0.0missingmissingmissing
6856Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_192533__59900.00038252.143110[339, 142]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192533__599.json0.0missingmissingmissing
6857Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_200102__21900.00040052.887950[339, 154]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200102__219.json0.0missingmissingmissing
6858Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_200108__50600.00066456.27580[339, 330]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200108__506.json50.0missingmissingmissing
6859Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue520231215_194240__66310.018.10392[339, 781]0.10.0-DEV41.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194240__663.json67.50.5missing0.5
6860Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_201939__99500.00068657.188780[338, 345]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_201939__995.json0.0missingmissingmissing
6861Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_192526__38000.0002891.618830[338, 80]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_192526__380.json0.0missingmissingmissing
6862Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231225_192529__44400.0004332.96830[338, 176]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_192529__444.json50.0missingmissingmissing
6863Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapTask1SHOTtruefalse520231227_200052__89400.0005114.352150[338, 228]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_200052__894.json25.0missingmissingmissing
6864Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231227_200059__78700.00069856.930570[338, 353]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_200059__787.json50.0missingmissingmissing
6865Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo--optimJuliaRecapTask1SHOTtruetrue520231215_194221__94300.04.457070[338, 199]0.10.0-DEV41.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_194221__943.json50.00.5missing0.5
6866Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200439__50200.00017250.8709950[81, 88]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200439__502.json50.0missingmissingmissing
6867Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200441__23410.000271.233161[81, 153]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200441__234.json61.25missingmissingmissing
6868Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200441__64200.0001530.9517890[81, 75]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200441__642.json50.0missingmissingmissing
6869Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200442__57100.00011550.5637920[81, 50]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200442__571.json50.0missingmissingmissing
6870Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200443__85810.0002461.308261[81, 137]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200443__858.json61.25missingmissingmissing
6871Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200436__53110.00013450.6348471[116, 51]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200436__531.json61.25missingmissingmissing
6872Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200436__61400.00012850.7707160[116, 47]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200436__614.json50.0missingmissingmissing
6873Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertAsk1SHOTfalsefalse520240201_200437__24900.00013450.7653660[116, 51]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200437__249.json0.0missingmissingmissing
6874Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200438__58500.00013150.546240[116, 49]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200438__585.json50.0missingmissingmissing
6875Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200438__60100.0001210.5560870[116, 42]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200438__601.json50.0missingmissingmissing
6876Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200432__60310.0003291.416571[190, 156]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200432__603.json61.25missingmissingmissing
6877Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200432__76700.00016250.6230370[190, 45]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200432__767.json50.0missingmissingmissing
6878Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200433__34910.00022550.9866151[190, 87]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200433__349.json61.25missingmissingmissing
6879Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200434__80000.00020450.9045540[190, 73]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200434__800.json50.0missingmissingmissing
6880Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200435__78400.00023450.8033380[190, 93]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200435__784.json50.0missingmissingmissing
6881Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200450__58000.0003811.098540[339, 141]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200450__580.json0.0missingmissingmissing
6882Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200451__16800.0003991.453080[339, 153]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200451__168.json50.0missingmissingmissing
6883Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200453__66600.00044551.585790[339, 184]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200453__666.json0.0missingmissingmissing
6884Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200454__26600.00031350.9251940[339, 96]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200454__266.json50.0missingmissingmissing
6885Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200456__29500.00043651.542620[339, 178]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200456__295.json0.0missingmissingmissing
6886Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200444__45800.0002740.6700190[338, 70]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200444__458.json50.0missingmissingmissing
6887Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200445__73600.00026950.8575560[338, 67]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200445__736.json50.0missingmissingmissing
6888Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200446__42810.0003851.115622[338, 144]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200446__428.json67.5missingmissingmissing
6889Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200447__46110.0003281.044072[338, 106]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200447__461.json67.5missingmissingmissing
6890Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200449__19600.0004781.608080[338, 206]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200449__196.json0.0missingmissingmissing
6891Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106AsIs1SHOTtruetrue520231213_201952__42800.0003043.010980[78, 113]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_201952__428.json50.0missingmissingmissing
6892Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_192547__18600.00031.883140[78, 111]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_192547__186.json50.0missingmissingmissing
6893Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_192549__59610.000292.045141[78, 106]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_192549__596.json61.25missingmissingmissing
6894Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106--optimAsIs1SHOTtruetrue520231215_194248__98200.02.34240[78, 73]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_194248__982.json50.00.9missing0.1
6895Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_201949__25410.0002911.748161[81, 105]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_201949__254.json61.25missingmissingmissing
6896Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_192542__90500.0003672.53731[81, 143]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_192542__905.json56.25missingmissingmissing
6897Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_192545__56710.0003332.473061[81, 126]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_192545__567.json61.25missingmissingmissing
6898Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_200117__98100.0004253.582541[81, 172]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_200117__981.json56.25missingmissingmissing
6899Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_200119__32300.0002051.686240[81, 62]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_200119__323.json50.0missingmissingmissing
6900Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_194245__75000.01.400860[81, 70]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_194245__750.json50.00.9missing0.1
6901Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_201947__33200.0002021.307040[116, 43]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_201947__332.json50.0missingmissingmissing
6902Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_192538__68910.0003041.867461[116, 94]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_192538__689.json61.25missingmissingmissing
6903Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_192539__64600.000221.364050[116, 52]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_192539__646.json50.0missingmissingmissing
6904Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_200112__79500.0002561.767390[116, 70]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_200112__795.json50.0missingmissingmissing
6905Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_200114__97800.0002221.298160[116, 53]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_200114__978.json50.0missingmissingmissing
6906Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_194244__43300.02.421280[116, 44]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_194244__433.json50.00.9missing0.1
6907Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_201945__47700.0002921.074840[190, 51]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_201945__477.json50.0missingmissingmissing
6908Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_192535__29000.0002961.393331[190, 53]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192535__290.json56.25missingmissingmissing
6909Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_192536__26800.0002940.9957950[190, 52]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192536__268.json50.0missingmissingmissing
6910Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_200109__57400.0003081.235590[190, 59]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200109__574.json50.0missingmissingmissing
6911Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_200110__64900.0002580.8405870[190, 34]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200110__649.json50.0missingmissingmissing
6912Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_194241__81800.01.466220[190, 50]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194241__818.json50.00.9missing0.1
6913Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231213_201957__99100.0004891.355010[339, 75]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_201957__991.json0.0missingmissingmissing
6914Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231225_192556__86810.0006872.449642[339, 174]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192556__868.json67.5missingmissingmissing
6915Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruefalse520231225_192557__75500.0005271.534230[339, 94]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192557__755.json25.0missingmissingmissing
6916Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_200127__46600.0004951.820640[339, 78]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200127__466.json0.0missingmissingmissing
6917Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231227_200130__89000.0006872.622090[339, 174]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200130__890.json50.0missingmissingmissing
6918Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_194252__92100.02.095490[339, 53]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194252__921.json0.00.9missing0.1
6919Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231213_201956__42100.0007683.818090[338, 215]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_201956__421.json0.0missingmissingmissing
6920Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_192551__40510.0005341.620232[338, 98]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_192551__405.json67.5missingmissingmissing
6921Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_192553__45210.000582.011952[338, 121]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_192553__452.json67.5missingmissingmissing
6922Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_200123__67310.0007163.580812[338, 189]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_200123__673.json67.5missingmissingmissing
6923Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_200125__84800.0006442.29942[338, 153]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_200125__848.json62.5missingmissingmissing
6924Apple-MacBook-Pro-M1extract_julia_codegpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_194250__21300.01.822130[338, 91]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_194250__213.json50.00.9missing0.1
6925Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewInJulia1SHOTtruetrue520240201_092708__75410.0075315.01181[81, 224]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_092708__754.json61.25missingmissingmissing
6926Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewInJulia1SHOTtruetrue520240201_092726__51600.0091518.45640[81, 278]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_092726__516.json50.0missingmissingmissing
6927Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewInJulia1SHOTtruetrue520240201_092742__48210.008116.14631[81, 243]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_092742__482.json61.25missingmissingmissing
6928Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewInJulia1SHOTtruetrue520240201_092755__31310.0052212.67691[81, 147]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_092755__313.json61.25missingmissingmissing
6929Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewInJulia1SHOTtruetrue520240201_092808__11800.006313.10310[81, 183]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_092808__118.json50.0missingmissingmissing
6930Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_092455__54900.002934.704740[116, 59]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_092455__549.json50.0missingmissingmissing
6931Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_092502__56610.003566.503871[116, 80]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_092502__566.json61.25missingmissingmissing
6932Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_092506__27300.002784.280590[116, 54]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_092506__273.json50.0missingmissingmissing
6933Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_092511__26700.002845.147440[116, 56]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_092511__267.json50.0missingmissingmissing
6934Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_092518__44300.00387.010570[116, 88]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_092518__443.json50.0missingmissingmissing
6935Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse520240201_092305__94400.006079.175670[190, 139]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_092305__944.json0.0missingmissingmissing
6936Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_092323__76210.009718.03871[190, 260]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_092323__762.json61.25missingmissingmissing
6937Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse520240201_092347__87000.0087724.22260[190, 229]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_092347__870.json0.0missingmissingmissing
6938Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_092406__61010.0076618.67841[190, 192]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_092406__610.json61.25missingmissingmissing
6939Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_092416__79600.0054410.23080[190, 118]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_092416__796.json50.0missingmissingmissing
6940Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_093653__75700.006488.142430[339, 103]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_093653__757.json50.0missingmissingmissing
6941Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_093702__94010.00669.065822[339, 107]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_093702__940.json67.5missingmissingmissing
6942Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_093757__80210.018355.0032[339, 497]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_093757__802.json67.5missingmissingmissing
6943Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapCoTTask1SHOTfalsefalse520240201_093841__41800.0154843.90260[339, 403]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_093841__418.json0.0missingmissingmissing
6944Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_093909__98610.0125427.84272[339, 305]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_093909__986.json67.5missingmissingmissing
6945Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_093135__52910.0095619.17592[338, 206]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_093135__529.json67.5missingmissingmissing
6946Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_093204__32710.0135829.65892[338, 340]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_093204__327.json67.5missingmissingmissing
6947Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_093248__63610.0167343.87842[338, 445]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_093248__636.json67.5missingmissingmissing
6948Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_093324__56200.0142736.12650[338, 363]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_093324__562.json50.0missingmissingmissing
6949Apple-MacBook-Pro-M1extract_julia_codegpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_093334__81510.0060810.00432[338, 90]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_093334__815.json67.5missingmissingmissing
6950Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewAsIs1SHOTtruetrue520231213_202210__46010.0142235.06961[78, 448]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_202210__460.json61.25missingmissingmissing
6951Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewAsIs1SHOTtruetrue520231225_192707__60110.007327.159281[78, 218]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_192707__601.json61.25missingmissingmissing
6952Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewAsIs1SHOTtruetrue520231225_192724__28010.0068116.77521[78, 201]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_192724__280.json61.25missingmissingmissing
6953Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_194543__58400.067.3350[78, 372]0.10.0-DEV41.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_194543__584.json0.00.1missing0.9
6954Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewInJulia1SHOTtruetrue520231213_202135__30410.0146141.17341[81, 460]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_202135__304.json61.25missingmissingmissing
6955Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewInJulia1SHOTtruetrue520231225_192647__56410.007812.91011[81, 233]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_192647__564.json61.25missingmissingmissing
6956Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewInJulia1SHOTtruetrue520231225_192659__82310.0106811.6271[81, 329]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_192659__823.json61.25missingmissingmissing
6957Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewInJulia1SHOTtruetrue520231227_200228__71700.0071418.1840[81, 211]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_200228__717.json50.0missingmissingmissing
6958Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewInJulia1SHOTtruetrue520231227_200243__73910.0086715.77821[81, 262]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_200243__739.json61.25missingmissingmissing
6959Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_194436__30610.051.4561[81, 393]0.10.0-DEV41.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_194436__306.json61.250.1missing0.9
6960Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_202054__18400.003896.308270[116, 91]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_202054__184.json50.0missingmissingmissing
6961Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_192631__72300.005757.937560[116, 153]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_192631__723.json50.0missingmissingmissing
6962Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_192634__42500.003232.417130[116, 69]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_192634__425.json50.0missingmissingmissing
6963Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_200203__90700.004225.845690[116, 102]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_200203__907.json50.0missingmissingmissing
6964Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_200209__51300.003236.121190[116, 69]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_200209__513.json50.0missingmissingmissing
6965Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_194344__90700.016.67920[116, 109]0.10.0-DEV41.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_194344__907.json50.00.1missing0.9
6966Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231213_202047__88400.0169350.15620[190, 501]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202047__884.json0.0missingmissingmissing
6967Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231225_192614__88400.0121316.22380[190, 341]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192614__884.json0.0missingmissingmissing
6968Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231225_192623__59400.008329.634180[190, 214]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192623__594.json0.0missingmissingmissing
6969Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_200138__28600.005328.735880[190, 114]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200138__286.json50.0missingmissingmissing
6970Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231227_200157__46000.0108118.79070[190, 297]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200157__460.json0.0missingmissingmissing
6971Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_194327__43300.035.68280[190, 366]0.10.0-DEV41.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194327__433.json0.00.1missing0.9
6972Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_202259__37510.0095421.87382[339, 205]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202259__375.json67.5missingmissingmissing
6973Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_192815__74210.0111619.56012[339, 259]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192815__742.json67.5missingmissingmissing
6974Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_192829__13900.013814.04520[339, 347]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192829__139.json50.0missingmissingmissing
6975Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_200338__47310.011716.12492[339, 277]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200338__473.json67.5missingmissingmissing
6976Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_200357__25910.0138918.91182[339, 350]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200357__259.json67.5missingmissingmissing
6977Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_194703__63510.024.20742[339, 322]0.10.0-DEV41.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194703__635.json67.50.1missing0.9
6978Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_202237__77810.0109126.71962[338, 251]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_202237__778.json67.5missingmissingmissing
6979Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_192740__71810.0125615.85972[338, 306]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_192740__718.json67.5missingmissingmissing
6980Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_192755__55600.0127414.41630[338, 312]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_192755__556.json50.0missingmissingmissing
6981Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_200301__75600.0132817.36040[338, 330]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_200301__756.json50.0missingmissingmissing
6982Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_200322__35310.0139420.29982[338, 352]0.10.0-DEV41.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_200322__353.json67.5missingmissingmissing
6983Apple-MacBook-Pro-M1extract_julia_codegpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_194639__93110.055.6182[338, 382]0.10.0-DEV41.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_194639__931.json67.50.1missing0.9
6984Apple-MacBook-Pro-M1extract_julia_codellama2AsIs1SHOTfalsefalse520231214_005800__39400.010.10850[72, 300]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__AsIs__1SHOT__20231214_005800__394.json0.0missingmissingmissing
6985Apple-MacBook-Pro-M1extract_julia_codellama2AsIs1SHOTfalsefalse520231225_140748__71600.013.58780[72, 404]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__AsIs__1SHOT__20231225_140748__716.json0.0missing{\n "num_gpu": 99\n}missing
6986Apple-MacBook-Pro-M1extract_julia_codellama2AsIs1SHOTfalsefalse520231225_140757__16200.08.697170[1, 275]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__AsIs__1SHOT__20231225_140757__162.json0.0missing{\n "num_gpu": 99\n}missing
6987Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTtruetrue520231214_005750__94800.016.29950[89, 476]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231214_005750__948.json50.0missingmissingmissing
6988Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTfalsefalse520231225_140722__17100.018.31630[89, 536]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231225_140722__171.json0.0missing{\n "num_gpu": 99\n}missing
6989Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTfalsefalse520231225_140735__89500.012.70060[1, 393]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231225_140735__895.json0.0missing{\n "num_gpu": 99\n}missing
6990Apple-MacBook-Pro-M1extract_julia_codellama2InJulia1SHOTfalsefalse520231227_001712__11300.020.60410[89, 605]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__InJulia__1SHOT__20231227_001712__113.json0.0missing{\n "num_gpu": 99\n}missing
6991Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTtruetrue520231214_005733__28200.03.286080[118, 78]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_005733__282.json50.0missingmissingmissing
6992Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTfalsefalse520231225_140659__61000.010.56390[118, 303]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_140659__610.json0.0missing{\n "num_gpu": 99\n}missing
6993Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTtruetrue520231225_140703__49900.03.988420[1, 127]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_140703__499.json50.0missing{\n "num_gpu": 99\n}missing
6994Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertAsk1SHOTtruetrue520231227_001651__32700.010.02470[118, 290]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_001651__327.json50.0missing{\n "num_gpu": 99\n}missing
6995Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruefalse520231214_005730__64400.012.90240[211, 336]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005730__644.json25.0missingmissingmissing
6996Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruetrue520231225_140639__12610.028.20021[229, 611]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140639__126.json61.25missing{\n "num_gpu": 99\n}missing
6997Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruetrue520231225_140649__60200.09.805330[1, 294]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140649__602.json50.0missing{\n "num_gpu": 99\n}missing
6998Apple-MacBook-Pro-M1extract_julia_codellama2JuliaExpertCoTTask1SHOTtruetrue520231227_001641__34000.014.73870[229, 250]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001641__340.json50.0missing{\n "num_gpu": 99\n}missing
6999Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTfalsefalse520231214_005836__47400.023.17750[11, 616]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_005836__474.json0.0missingmissingmissing
7000Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTtruetrue520231225_140847__66300.015.29450[11, 420]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140847__663.json50.0missing{\n "num_gpu": 99\n}missing
7001Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTfalsefalse520231225_140849__10300.01.972690[1, 57]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140849__103.json0.0missing{\n "num_gpu": 99\n}missing
7002Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapCoTTask1SHOTfalsefalse520231227_001746__97100.021.9140[11, 595]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001746__971.json0.0missing{\n "num_gpu": 99\n}missing
7003Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTfalsefalse520231214_005813__24600.013.14950[389, 270]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_005813__246.json0.0missingmissingmissing
7004Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTfalsefalse520231225_140802__17100.04.851010[389, 36]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_140802__171.json0.0missing{\n "num_gpu": 99\n}missing
7005Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTtruetrue520231225_140831__17900.029.37980[1, 776]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_140831__179.json50.0missing{\n "num_gpu": 99\n}missing
7006Apple-MacBook-Pro-M1extract_julia_codellama2JuliaRecapTask1SHOTfalsefalse520231227_001724__13400.012.25190[389, 250]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_001724__134.json0.0missing{\n "num_gpu": 99\n}missing
7007Apple-MacBook-Pro-M1extract_julia_codemagicoderAsIs1SHOTfalsefalse520231214_072718__76000.023.50080[72, 288]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__AsIs__1SHOT__20231214_072718__760.json0.0missingmissingmissing
7008Apple-MacBook-Pro-M1extract_julia_codemagicoderAsIs1SHOTfalsefalse520231225_143020__73700.07.768130[86, 253]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__AsIs__1SHOT__20231225_143020__737.json0.0missing{\n "num_gpu": 99\n}missing
7009Apple-MacBook-Pro-M1extract_julia_codemagicoderAsIs1SHOTfalsefalse520231225_143029__59000.08.840150[86, 289]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__AsIs__1SHOT__20231225_143029__590.json0.0missing{\n "num_gpu": 99\n}missing
7010Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231214_072654__47800.048.69110[89, 373]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231214_072654__478.json50.0missingmissingmissing
7011Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231225_143003__36610.09.816181[89, 323]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231225_143003__366.json61.25missing{\n "num_gpu": 99\n}missing
7012Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231225_143012__93910.09.084712[89, 297]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231225_143012__939.json67.5missing{\n "num_gpu": 99\n}missing
7013Apple-MacBook-Pro-M1extract_julia_codemagicoderInJulia1SHOTtruetrue520231227_002458__61710.08.709722[89, 283]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__InJulia__1SHOT__20231227_002458__617.json67.5missing{\n "num_gpu": 99\n}missing
7014Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTfalsefalse520231214_072605__94900.055.15430[118, 420]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_072605__949.json0.0missingmissingmissing
7015Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTtruetrue520231225_142942__71200.07.410920[128, 236]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_142942__712.json50.0missing{\n "num_gpu": 99\n}missing
7016Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTfalsefalse520231225_142953__70200.010.35980[128, 334]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_142953__702.json0.0missing{\n "num_gpu": 99\n}missing
7017Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertAsk1SHOTtruetrue520231227_002450__71500.09.901970[128, 317]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_002450__715.json50.0missing{\n "num_gpu": 99\n}missing
7018Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruetrue520231214_072510__55110.0106.2532[211, 622]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_072510__551.json67.5missingmissingmissing
7019Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_142928__15400.016.07490[221, 308]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142928__154.json50.0missing{\n "num_gpu": 99\n}missing
7020Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_142935__87400.06.708340[221, 194]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_142935__874.json0.0missing{\n "num_gpu": 99\n}missing
7021Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaExpertCoTTask1SHOTtruefalse520231227_002440__34800.013.53330[221, 229]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002440__348.json25.0missing{\n "num_gpu": 99\n}missing
7022Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_072804__46100.015.9150[11, 435]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_072804__461.json50.0missingmissingmissing
7023Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_143103__72700.05.501030[392, 124]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143103__727.json50.0missing{\n "num_gpu": 99\n}missing
7024Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_143118__28210.014.46011[392, 410]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143118__282.json61.25missing{\n "num_gpu": 99\n}missing
7025Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapCoTTask1SHOTfalsefalse520231227_002530__77000.013.8370[392, 388]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002530__770.json0.0missing{\n "num_gpu": 99\n}missing
7026Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruetrue520231214_072748__80100.030.41870[389, 712]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_072748__801.json50.0missingmissingmissing
7027Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruetrue520231225_143042__70510.012.54752[389, 351]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_143042__705.json67.5missing{\n "num_gpu": 99\n}missing
7028Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTfalsefalse520231225_143057__17700.015.30[389, 436]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_143057__177.json0.0missing{\n "num_gpu": 99\n}missing
7029Apple-MacBook-Pro-M1extract_julia_codemagicoderJuliaRecapTask1SHOTtruetrue520231227_002516__84910.016.81362[389, 480]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_002516__849.json67.5missing{\n "num_gpu": 99\n}missing
7030Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KInJulia1SHOTfalsefalse520231227_180952__50700.017.4110[89, 337]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180952__507.json0.0missing{\n "num_gpu": 99\n}missing
7031Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_180957__73600.05.676140[89, 104]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_180957__736.json50.0missing{\n "num_gpu": 99\n}missing
7032Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181020__88910.023.1061[89, 448]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181020__889.json61.25missing{\n "num_gpu": 99\n}missing
7033Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_180855__29900.011.69910[128, 220]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180855__299.json50.0missing{\n "num_gpu": 99\n}missing
7034Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_180916__17400.020.79130[128, 398]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180916__174.json0.0missing{\n "num_gpu": 99\n}missing
7035Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_180934__74200.018.23230[128, 349]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_180934__742.json0.0missing{\n "num_gpu": 99\n}missing
7036Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180814__32400.011.95330[221, 213]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180814__324.json50.0missing{\n "num_gpu": 99\n}missing
7037Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180830__50800.015.66981[221, 286]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180830__508.json56.25missing{\n "num_gpu": 99\n}missing
7038Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_180843__62500.012.85950[221, 231]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_180843__625.json50.0missing{\n "num_gpu": 99\n}missing
7039Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181138__94500.015.75930[392, 264]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181138__945.json50.0missing{\n "num_gpu": 99\n}missing
7040Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_181156__68900.017.54770[392, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181156__689.json0.0missing{\n "num_gpu": 99\n}missing
7041Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181207__47210.010.7231[392, 167]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181207__472.json61.25missing{\n "num_gpu": 99\n}missing
7042Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181040__75210.019.63611[389, 338]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181040__752.json61.25missing{\n "num_gpu": 99\n}missing
7043Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181057__82700.016.96970[389, 287]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181057__827.json50.0missing{\n "num_gpu": 99\n}missing
7044Apple-MacBook-Pro-M1extract_julia_codemagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181122__28510.024.26071[389, 425]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181122__285.json61.25missing{\n "num_gpu": 99\n}missing
7045Apple-MacBook-Pro-M1extract_julia_codemistral-mediumAsIs1SHOTtruetrue520231213_202512__44600.0032686415.9140[84, 376]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__AsIs__1SHOT__20231213_202512__446.json50.0missingmissingmissing
7046Apple-MacBook-Pro-M1extract_julia_codemistral-mediumAsIs1SHOTtruetrue520231225_193151__51900.00257296.467310[84, 290]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__AsIs__1SHOT__20231225_193151__519.json50.0missingmissingmissing
7047Apple-MacBook-Pro-M1extract_julia_codemistral-mediumAsIs1SHOTtruetrue520231225_193200__78310.00322018.258012[84, 370]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__AsIs__1SHOT__20231225_193200__783.json67.5missingmissingmissing
7048Apple-MacBook-Pro-M1extract_julia_codemistral-medium--optimAsIs1SHOTtruefalse520231215_194852__19600.05.773570[84, 261]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__AsIs__1SHOT__20231215_194852__196.json25.00.9missing0.3
7049Apple-MacBook-Pro-M1extract_julia_codemistral-mediumInJulia1SHOTtruefalse520231213_202456__11600.0038673118.71680[87, 449]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__InJulia__1SHOT__20231213_202456__116.json25.0missingmissingmissing
7050Apple-MacBook-Pro-M1extract_julia_codemistral-mediumInJulia1SHOTtruefalse520231225_193135__49900.003074497.862050[87, 351]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__InJulia__1SHOT__20231225_193135__499.json25.0missingmissingmissing
7051Apple-MacBook-Pro-M1extract_julia_codemistral-mediumInJulia1SHOTtruefalse520231225_193145__80600.002750899.972410[87, 311]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__InJulia__1SHOT__20231225_193145__806.json25.0missingmissingmissing
7052Apple-MacBook-Pro-M1extract_julia_codemistral-mediumInJulia1SHOTfalsefalse520231227_200713__89900.003058318.212650[87, 349]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__InJulia__1SHOT__20231227_200713__899.json0.0missingmissingmissing
7053Apple-MacBook-Pro-M1extract_julia_codemistral-mediumInJulia1SHOTfalsefalse520231227_200721__76800.003090677.939040[87, 353]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__InJulia__1SHOT__20231227_200721__768.json0.0missingmissingmissing
7054Apple-MacBook-Pro-M1extract_julia_codemistral-medium--optimInJulia1SHOTtruefalse520231215_194846__29800.012.95680[87, 296]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__InJulia__1SHOT__20231215_194846__298.json25.00.9missing0.3
7055Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertAsk1SHOTtruefalse520231213_202437__89200.002176639.48860[126, 227]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_202437__892.json25.0missingmissingmissing
7056Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_193116__76800.0027105714.01710[126, 293]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_193116__768.json25.0missingmissingmissing
7057Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_193126__71500.003891719.841330[126, 439]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_193126__715.json25.0missingmissingmissing
7058Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_200657__45700.002362716.29870[126, 250]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_200657__457.json25.0missingmissingmissing
7059Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_200705__65400.002734846.649760[126, 296]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_200705__654.json25.0missingmissingmissing
7060Apple-MacBook-Pro-M1extract_julia_codemistral-medium--optimJuliaExpertAsk1SHOTtruefalse520231215_194833__22000.018.40320[126, 308]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_194833__220.json25.00.9missing0.3
7061Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_202427__27400.0044340519.95860[219, 475]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202427__274.json50.0missingmissingmissing
7062Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertCoTTask1SHOTfalsefalse520231225_193044__41900.0040942723.73580[219, 433]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193044__419.json0.0missingmissingmissing
7063Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231225_193101__69700.0042237117.83110[219, 449]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193101__697.json25.0missingmissingmissing
7064Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_200606__62200.0038758418.4330[219, 406]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200606__622.json25.0missingmissingmissing
7065Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_200641__83100.0040295534.59110[219, 425]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200641__831.json25.0missingmissingmissing
7066Apple-MacBook-Pro-M1extract_julia_codemistral-medium--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_194815__29000.018.90350[219, 346]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194815__290.json0.00.9missing0.3
7067Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_202555__84110.0049739520.65532[389, 485]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202555__841.json67.5missingmissingmissing
7068Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_193257__97200.0059447533.09510[389, 605]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193257__972.json25.0missingmissingmissing
7069Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_193337__86210.0044238340.35012[389, 417]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193337__862.json67.5missingmissingmissing
7070Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_200810__61300.0042458517.54260[389, 395]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200810__613.json50.0missingmissingmissing
7071Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231227_200827__37000.0039303416.81650[389, 356]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200827__370.json25.0missingmissingmissing
7072Apple-MacBook-Pro-M1extract_julia_codemistral-medium--optimJuliaRecapCoTTask1SHOTtruefalse520231215_194917__81000.014.25460[389, 372]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194917__810.json25.00.9missing0.3
7073Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapTask1SHOTtruetrue520231213_202534__38110.0053541722.26142[386, 533]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_202534__381.json67.5missingmissingmissing
7074Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapTask1SHOTtruefalse520231225_193208__59900.004108318.68640[386, 379]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_193208__599.json25.0missingmissingmissing
7075Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapTask1SHOTtruefalse520231225_193223__75500.0052247314.65370[386, 517]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_193223__755.json25.0missingmissingmissing
7076Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapTask1SHOTtruetrue520231227_200737__18900.0057101315.65610[386, 577]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_200737__189.json50.0missingmissingmissing
7077Apple-MacBook-Pro-M1extract_julia_codemistral-mediumJuliaRecapTask1SHOTtruetrue520231227_200752__61810.0039626915.20862[386, 361]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_200752__618.json67.5missingmissingmissing
7078Apple-MacBook-Pro-M1extract_julia_codemistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_194902__97310.010.14742[386, 449]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_194902__973.json67.50.9missing0.3
7079Apple-MacBook-Pro-M1extract_julia_codemistral-smallAsIs1SHOTtruetrue520231213_202345__25810.001078027.072551[86, 527]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__AsIs__1SHOT__20231213_202345__258.json61.25missingmissingmissing
7080Apple-MacBook-Pro-M1extract_julia_codemistral-smallAsIs1SHOTtruetrue520231225_192952__76210.0007016624.488191[86, 333]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__AsIs__1SHOT__20231225_192952__762.json61.25missingmissingmissing
7081Apple-MacBook-Pro-M1extract_julia_codemistral-smallAsIs1SHOTfalsefalse520231225_192958__18100.0009305826.053210[86, 451]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__AsIs__1SHOT__20231225_192958__181.json0.0missingmissingmissing
7082Apple-MacBook-Pro-M1extract_julia_codemistral-small--optimAsIs1SHOTtruetrue520231215_194741__71410.06.195491[86, 463]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__AsIs__1SHOT__20231215_194741__714.json61.250.9missing0.3
7083Apple-MacBook-Pro-M1extract_julia_codemistral-smallInJulia1SHOTtruetrue520231213_202338__92710.0005406433.41052[89, 249]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__InJulia__1SHOT__20231213_202338__927.json67.5missingmissingmissing
7084Apple-MacBook-Pro-M1extract_julia_codemistral-smallInJulia1SHOTtruetrue520231225_192943__39210.0007812035.019571[89, 373]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__InJulia__1SHOT__20231225_192943__392.json61.25missingmissingmissing
7085Apple-MacBook-Pro-M1extract_julia_codemistral-smallInJulia1SHOTtruetrue520231225_192947__40710.0006473434.221641[89, 304]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__InJulia__1SHOT__20231225_192947__407.json61.25missingmissingmissing
7086Apple-MacBook-Pro-M1extract_julia_codemistral-smallInJulia1SHOTtruetrue520231227_200459__27000.0009189435.98891[89, 444]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__InJulia__1SHOT__20231227_200459__270.json56.25missingmissingmissing
7087Apple-MacBook-Pro-M1extract_julia_codemistral-smallInJulia1SHOTfalsefalse520231227_200505__27200.0009286436.023620[89, 449]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__InJulia__1SHOT__20231227_200505__272.json0.0missingmissingmissing
7088Apple-MacBook-Pro-M1extract_julia_codemistral-small--optimInJulia1SHOTfalsefalse520231215_194735__62800.03.681950[89, 273]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__InJulia__1SHOT__20231215_194735__628.json0.00.9missing0.3
7089Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertAsk1SHOTtruetrue520231213_202335__44300.000774754.886810[130, 356]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_202335__443.json50.0missingmissingmissing
7090Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertAsk1SHOTtruetrue520231225_192935__55400.000982336.206940[130, 463]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_192935__554.json50.0missingmissingmissing
7091Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertAsk1SHOTtruetrue520231225_192938__47710.000431372.569821[130, 179]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_192938__477.json61.25missingmissingmissing
7092Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertAsk1SHOTtruetrue520231227_200447__68000.000770874.915990[130, 354]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_200447__680.json50.0missingmissingmissing
7093Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertAsk1SHOTtruetrue520231227_200453__58000.000877575.625610[130, 409]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_200453__580.json50.0missingmissingmissing
7094Apple-MacBook-Pro-M1extract_julia_codemistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_194731__85500.04.892240[130, 372]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_194731__855.json50.00.9missing0.3
7095Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_202330__80200.0009713685.848570[224, 426]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202330__802.json50.0missingmissingmissing
7096Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231225_192924__13000.0008161684.793220[224, 346]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192924__130.json0.0missingmissingmissing
7097Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231225_192929__93500.0008530284.980090[224, 365]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192929__935.json0.0missingmissingmissing
7098Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_200437__81610.0008724285.22522[224, 375]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200437__816.json67.5missingmissingmissing
7099Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_200442__67610.0006997684.28662[224, 286]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200442__676.json67.5missingmissingmissing
7100Apple-MacBook-Pro-M1extract_julia_codemistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_194727__42800.04.231410[224, 313]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194727__428.json50.00.9missing0.3
7101Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_202407__35010.0019750512.2242[396, 886]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202407__350.json67.5missingmissingmissing
7102Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_193015__85710.001294117.288622[396, 535]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193015__857.json67.5missingmissingmissing
7103Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_193020__93000.0009546124.986042[396, 360]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193020__930.json62.5missingmissingmissing
7104Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_200540__95510.001480358.707072[396, 631]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200540__955.json67.5missingmissingmissing
7105Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_200548__19610.001369777.792842[396, 574]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200548__196.json67.5missingmissingmissing
7106Apple-MacBook-Pro-M1extract_julia_codemistral-small--optimJuliaRecapCoTTask1SHOTtruefalse520231215_194756__14400.05.974520[396, 446]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194756__144.json25.00.9missing0.3
7107Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapTask1SHOTtruetrue520231213_202355__82000.001351029.331050[394, 565]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_202355__820.json50.0missingmissingmissing
7108Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapTask1SHOTtruetrue520231225_193003__78900.0008640784.320772[394, 314]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_193003__789.json62.5missingmissingmissing
7109Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapTask1SHOTtruetrue520231225_193007__62010.0008660184.29522[394, 315]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_193007__620.json67.5missingmissingmissing
7110Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapTask1SHOTtruetrue520231227_200517__59000.0019543611.90530[394, 876]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_200517__590.json50.0missingmissingmissing
7111Apple-MacBook-Pro-M1extract_julia_codemistral-smallJuliaRecapTask1SHOTtruetrue520231227_200531__74500.0022434213.94650[394, 1025]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_200531__745.json50.0missingmissingmissing
7112Apple-MacBook-Pro-M1extract_julia_codemistral-small--optimJuliaRecapTask1SHOTfalsefalse520231215_194750__46400.08.335270[394, 620]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_194750__464.json0.00.9missing0.3
7113Apple-MacBook-Pro-M1extract_julia_codemistral-tinyAsIs1SHOTfalsefalse520231213_202313__29200.000107173.826310[86, 210]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__AsIs__1SHOT__20231213_202313__292.json0.0missingmissingmissing
7114Apple-MacBook-Pro-M1extract_julia_codemistral-tinyAsIs1SHOTtruetrue520231225_192857__95100.0001008281.837930[86, 196]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__AsIs__1SHOT__20231225_192857__951.json50.0missingmissingmissing
7115Apple-MacBook-Pro-M1extract_julia_codemistral-tinyAsIs1SHOTtruetrue520231225_192859__45300.0001175892.109250[86, 233]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__AsIs__1SHOT__20231225_192859__453.json50.0missingmissingmissing
7116Apple-MacBook-Pro-M1extract_julia_codemistral-tiny--optimAsIs1SHOTtruetrue520231215_194713__18100.03.090020[86, 143]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__AsIs__1SHOT__20231215_194713__181.json50.00.9missing0.3
7117Apple-MacBook-Pro-M1extract_julia_codemistral-tinyInJulia1SHOTtruetrue520231213_202309__57700.0001823354.091542[89, 375]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__InJulia__1SHOT__20231213_202309__577.json62.5missingmissingmissing
7118Apple-MacBook-Pro-M1extract_julia_codemistral-tinyInJulia1SHOTfalsefalse520231225_192852__55709.4453e-52.435640[89, 181]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__InJulia__1SHOT__20231225_192852__557.json0.0missingmissingmissing
7119Apple-MacBook-Pro-M1extract_julia_codemistral-tinyInJulia1SHOTtruetrue520231225_192855__91200.0001089491.926640[89, 213]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__InJulia__1SHOT__20231225_192855__912.json50.0missingmissingmissing
7120Apple-MacBook-Pro-M1extract_julia_codemistral-tinyInJulia1SHOTtruefalse520231227_200413__78400.0001071371.989810[89, 209]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__InJulia__1SHOT__20231227_200413__784.json25.0missingmissingmissing
7121Apple-MacBook-Pro-M1extract_julia_codemistral-tinyInJulia1SHOTtruetrue520231227_200416__76000.0001193682.16662[89, 236]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__InJulia__1SHOT__20231227_200416__760.json62.5missingmissingmissing
7122Apple-MacBook-Pro-M1extract_julia_codemistral-tiny--optimInJulia1SHOTtruetrue520231215_194709__15000.01.460080[89, 161]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__InJulia__1SHOT__20231215_194709__150.json50.00.9missing0.3
7123Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertAsk1SHOTfalsefalse520231213_202305__19406.0782e-51.444510[130, 94]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_202305__194.json0.0missingmissingmissing
7124Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_192840__25100.000131452.201950[130, 250]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_192840__251.json50.0missingmissingmissing
7125Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_192850__99907.5278e-510.12190[130, 126]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_192850__999.json0.0missingmissingmissing
7126Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_200409__18706.8936e-51.106030[130, 112]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_200409__187.json50.0missingmissingmissing
7127Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_200411__46410.0001174072.049372[130, 219]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_200411__464.json67.5missingmissingmissing
7128Apple-MacBook-Pro-M1extract_julia_codemistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_194708__47510.01.808422[130, 197]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_194708__475.json67.50.9missing0.3
7129Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231213_202304__50909.2968e-54.117120[224, 136]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202304__509.json0.0missingmissingmissing
7130Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_192837__45507.1224e-50.9094160[224, 88]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192837__455.json0.0missingmissingmissing
7131Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_192837__98000.0001364567.17970[224, 232]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_192837__980.json0.0missingmissingmissing
7132Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231227_200406__24100.0001183367.955580[224, 192]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200406__241.json0.0missingmissingmissing
7133Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231227_200408__84500.000149142.403170[224, 260]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200408__845.json0.0missingmissingmissing
7134Apple-MacBook-Pro-M1extract_julia_codemistral-tiny--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_194706__88100.02.742530[224, 92]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194706__881.json0.00.9missing0.3
7135Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_202324__75800.0002085543.461040[396, 338]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202324__758.json50.0missingmissingmissing
7136Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_192915__45400.0002873764.834330[396, 512]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192915__454.json50.0missingmissingmissing
7137Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapCoTTask1SHOTtruefalse520231225_192919__72600.0002158023.290030[396, 354]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_192919__726.json25.0missingmissingmissing
7138Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_200427__78500.0002013063.015990[396, 322]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200427__785.json50.0missingmissingmissing
7139Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231227_200432__56700.0002606494.210080[396, 453]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200432__567.json0.0missingmissingmissing
7140Apple-MacBook-Pro-M1extract_julia_codemistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_194722__53900.04.502970[396, 480]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194722__539.json50.00.9missing0.3
7141Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapTask1SHOTtruefalse520231213_202320__73900.0002549337.094430[394, 441]0.10.0-DEV41.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_202320__739.json25.0missingmissingmissing
7142Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapTask1SHOTtruetrue520231225_192906__82710.0003228836.744282[394, 591]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_192906__827.json67.5missingmissingmissing
7143Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapTask1SHOTtruetrue520231225_192910__70010.0002762244.59022[394, 488]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_192910__700.json67.5missingmissingmissing
7144Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapTask1SHOTtruetrue520231227_200420__16200.0002698824.422740[394, 474]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_200420__162.json50.0missingmissingmissing
7145Apple-MacBook-Pro-M1extract_julia_codemistral-tinyJuliaRecapTask1SHOTfalsefalse520231227_200424__19200.0002494974.020720[394, 429]0.10.0-DEV41.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_200424__192.json0.0missingmissingmissing
7146Apple-MacBook-Pro-M1extract_julia_codemistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_194718__38500.05.084430[394, 597]0.10.0-DEV41.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_194718__385.json50.00.9missing0.3
7147Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231220_074017__31000.017.21840[72, 504]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231220_074017__310.json0.0missingmissingmissing
7148Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MAsIs1SHOTtruetrue520231225_145817__42710.08.872721[85, 220]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_145817__427.json61.25missing{\n "num_gpu": 99\n}missing
7149Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_145828__81800.010.6440[85, 266]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_145828__818.json0.0missing{\n "num_gpu": 99\n}missing
7150Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231220_073949__97000.015.80770[1, 482]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231220_073949__970.json50.0missingmissingmissing
7151Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231220_074000__68000.010.21060[1, 320]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231220_074000__680.json50.0missingmissingmissing
7152Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_145800__76700.07.367940[88, 181]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_145800__767.json0.0missing{\n "num_gpu": 99\n}missing
7153Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_145808__47600.08.109710[88, 200]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_145808__476.json0.0missing{\n "num_gpu": 99\n}missing
7154Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231227_003945__72000.06.876290[88, 167]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_003945__720.json0.0missing{\n "num_gpu": 99\n}missing
7155Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_235349__82400.012.23040[118, 351]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_235349__824.json50.0missingmissingmissing
7156Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231220_073915__95100.010.67410[135, 299]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231220_073915__951.json50.0missingmissingmissing
7157Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_145745__91000.07.639090[129, 179]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145745__910.json50.0missing{\n "num_gpu": 99\n}missing
7158Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_145753__44200.07.448250[129, 174]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145753__442.json0.0missing{\n "num_gpu": 99\n}missing
7159Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_003938__57400.012.20660[129, 295]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_003938__574.json50.0missing{\n "num_gpu": 99\n}missing
7160Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_235325__75800.05.669950[1, 174]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_235325__758.json50.0missingmissingmissing
7161Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_235337__18300.012.22910[1, 363]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_235337__183.json50.0missingmissingmissing
7162Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_145732__57500.011.33290[223, 119]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145732__575.json0.0missing{\n "num_gpu": 99\n}missing
7163Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_145738__70300.06.173090[223, 130]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145738__703.json0.0missing{\n "num_gpu": 99\n}missing
7164Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_003925__22010.021.15891[223, 374]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_003925__220.json61.25missing{\n "num_gpu": 99\n}missing
7165Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145911__48210.014.99730[396, 325]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145911__482.json55.0missing{\n "num_gpu": 99\n}missing
7166Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_145928__62100.016.95591[396, 373]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145928__621.json56.25missing{\n "num_gpu": 99\n}missing
7167Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_003959__63700.06.150090[396, 102]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003959__637.json0.0missing{\n "num_gpu": 99\n}missing
7168Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145837__69300.09.084080[394, 177]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145837__693.json50.0missing{\n "num_gpu": 99\n}missing
7169Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_145856__64100.018.62760[394, 414]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145856__641.json0.0missing{\n "num_gpu": 99\n}missing
7170Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_003953__87400.08.204220[394, 154]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_003953__874.json50.0missing{\n "num_gpu": 99\n}missing
7171Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_234122__82500.020.13590[87, 635]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234122__825.json0.0missing{\n "num_gpu": 99\n}missing
7172Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234133__90410.010.8832[87, 343]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234133__904.json67.5missing{\n "num_gpu": 99\n}missing
7173Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_234141__16700.08.164040[87, 255]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234141__167.json25.0missing{\n "num_gpu": 99\n}missing
7174Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234151__39900.09.451790[87, 297]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234151__399.json50.0missing{\n "num_gpu": 99\n}missing
7175Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231227_234201__72610.09.479052[87, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_234201__726.json67.5missing{\n "num_gpu": 99\n}missing
7176Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234038__99600.03.154590[128, 85]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234038__996.json0.0missing{\n "num_gpu": 99\n}missing
7177Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231227_234042__14800.04.385650[128, 126]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234042__148.json50.0missing{\n "num_gpu": 99\n}missing
7178Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234050__63000.07.932530[128, 242]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234050__630.json0.0missing{\n "num_gpu": 99\n}missing
7179Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234055__92200.04.9850[128, 146]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234055__922.json0.0missing{\n "num_gpu": 99\n}missing
7180Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_234102__80100.06.534120[128, 196]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_234102__801.json0.0missing{\n "num_gpu": 99\n}missing
7181Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_233948__52500.013.13580[222, 365]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_233948__525.json0.0missing{\n "num_gpu": 99\n}missing
7182Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234004__84300.016.62480[222, 498]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234004__843.json50.0missing{\n "num_gpu": 99\n}missing
7183Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234015__35300.010.59630[222, 310]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234015__353.json50.0missing{\n "num_gpu": 99\n}missing
7184Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234025__46710.010.10182[222, 294]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234025__467.json67.5missing{\n "num_gpu": 99\n}missing
7185Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_234035__25500.09.554060[222, 277]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234035__255.json0.0missing{\n "num_gpu": 99\n}missing
7186Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_234323__92000.010.60550[395, 277]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234323__920.json25.0missing{\n "num_gpu": 99\n}missing
7187Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234336__76800.012.90840[395, 348]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234336__768.json50.0missing{\n "num_gpu": 99\n}missing
7188Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234357__97100.021.08420[395, 594]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234357__971.json50.0missing{\n "num_gpu": 99\n}missing
7189Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234414__43800.017.06350[395, 474]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234414__438.json50.0missing{\n "num_gpu": 99\n}missing
7190Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231227_234427__70500.012.4340[395, 333]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234427__705.json50.0missing{\n "num_gpu": 99\n}missing
7191Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234213__15600.012.03360[393, 321]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234213__156.json50.0missing{\n "num_gpu": 99\n}missing
7192Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234226__12900.012.66120[393, 340]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234226__129.json50.0missing{\n "num_gpu": 99\n}missing
7193Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_234245__18200.019.03050[393, 533]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234245__182.json50.0missing{\n "num_gpu": 99\n}missing
7194Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_234301__28200.015.35660[393, 422]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234301__282.json25.0missing{\n "num_gpu": 99\n}missing
7195Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_234312__55200.011.03970[393, 290]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_234312__552.json0.0missing{\n "num_gpu": 99\n}missing
7196Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231227_234623__54500.010.39620[87, 257]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234623__545.json0.0missing{\n "num_gpu": 99\n}missing
7197Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_234631__55600.08.718720[87, 214]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234631__556.json50.0missing{\n "num_gpu": 99\n}missing
7198Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_234644__54200.012.19470[87, 303]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234644__542.json50.0missing{\n "num_gpu": 99\n}missing
7199Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_234649__52800.04.900840[87, 115]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234649__528.json25.0missing{\n "num_gpu": 99\n}missing
7200Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_234658__18600.09.49831[87, 234]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_234658__186.json56.25missing{\n "num_gpu": 99\n}missing
7201Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_234530__78600.05.989350[128, 138]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234530__786.json0.0missing{\n "num_gpu": 99\n}missing
7202Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_234540__80700.010.28362[128, 249]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234540__807.json62.5missing{\n "num_gpu": 99\n}missing
7203Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_234554__50800.013.68422[128, 335]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234554__508.json62.5missing{\n "num_gpu": 99\n}missing
7204Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_234600__92600.04.790940[128, 107]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234600__926.json0.0missing{\n "num_gpu": 99\n}missing
7205Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_234612__54500.012.47950[128, 305]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_234612__545.json50.0missing{\n "num_gpu": 99\n}missing
7206Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_234442__12600.014.98550[222, 331]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234442__126.json50.0missing{\n "num_gpu": 99\n}missing
7207Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_234455__40300.012.97210[222, 302]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234455__403.json50.0missing{\n "num_gpu": 99\n}missing
7208Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_234506__99210.010.79892[222, 247]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234506__992.json67.5missing{\n "num_gpu": 99\n}missing
7209Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_234516__27900.09.739690[222, 220]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234516__279.json0.0missing{\n "num_gpu": 99\n}missing
7210Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_234524__18300.08.317520[222, 184]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234524__183.json0.0missing{\n "num_gpu": 99\n}missing
7211Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_234843__78800.017.92920[395, 393]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234843__788.json50.0missing{\n "num_gpu": 99\n}missing
7212Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_234857__72900.013.68270[395, 289]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234857__729.json50.0missing{\n "num_gpu": 99\n}missing
7213Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_234909__68200.012.51170[395, 260]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234909__682.json0.0missing{\n "num_gpu": 99\n}missing
7214Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_234924__24500.014.98460[395, 321]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234924__245.json25.0missing{\n "num_gpu": 99\n}missing
7215Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_234937__72300.012.3810[395, 257]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_234937__723.json50.0missing{\n "num_gpu": 99\n}missing
7216Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234717__21900.018.02230[393, 395]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234717__219.json50.0missing{\n "num_gpu": 99\n}missing
7217Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_234729__22500.011.88050[393, 244]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234729__225.json25.0missing{\n "num_gpu": 99\n}missing
7218Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234746__69110.016.91012[393, 368]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234746__691.json67.5missing{\n "num_gpu": 99\n}missing
7219Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234803__57800.017.3910[393, 380]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234803__578.json50.0missing{\n "num_gpu": 99\n}missing
7220Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_234825__50010.021.30662[393, 475]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_234825__500.json67.5missing{\n "num_gpu": 99\n}missing
7221Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KAsIs1SHOTtruetrue520231226_122105__83700.09.801170[84, 176]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_122105__837.json50.0missing{\n "num_gpu": 99\n}missing
7222Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_122121__49700.015.50780[84, 284]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_122121__497.json0.0missing{\n "num_gpu": 99\n}missing
7223Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_122042__26300.013.4470[87, 245]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122042__263.json0.0missing{\n "num_gpu": 99\n}missing
7224Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122055__58400.012.84960[87, 234]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122055__584.json50.0missing{\n "num_gpu": 99\n}missing
7225Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231227_004215__43800.010.39570[87, 187]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_004215__438.json0.0missing{\n "num_gpu": 99\n}missing
7226Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_122008__78100.06.77660[128, 115]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122008__781.json0.0missing{\n "num_gpu": 99\n}missing
7227Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_122028__92800.020.73280[128, 377]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122028__928.json0.0missing{\n "num_gpu": 99\n}missing
7228Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_004205__46200.08.83310[128, 154]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_004205__462.json0.0missing{\n "num_gpu": 99\n}missing
7229Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_121945__29800.05.794010[222, 86]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_121945__298.json0.0missing{\n "num_gpu": 99\n}missing
7230Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122001__67700.015.66760[222, 271]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122001__677.json50.0missing{\n "num_gpu": 99\n}missing
7231Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_004156__68700.030.29440[222, 375]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004156__687.json50.0missing{\n "num_gpu": 99\n}missing
7232Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122255__28400.024.00080[395, 400]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122255__284.json50.0missing{\n "num_gpu": 99\n}missing
7233Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122318__58900.022.84352[395, 379]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122318__589.json62.5missing{\n "num_gpu": 99\n}missing
7234Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_004256__33600.025.39830[395, 424]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004256__336.json25.0missing{\n "num_gpu": 99\n}missing
7235Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122152__86800.031.57190[393, 536]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122152__868.json50.0missing{\n "num_gpu": 99\n}missing
7236Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122231__14810.038.89912[393, 666]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122231__148.json67.5missing{\n "num_gpu": 99\n}missing
7237Apple-MacBook-Pro-M1extract_julia_codemistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_004231__70900.015.68130[393, 248]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_004231__709.json0.0missing{\n "num_gpu": 99\n}missing
7238Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_115432__61200.0133.0530[88, 785]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_115432__612.json50.0missing{\n "num_gpu": 99\n}missing
7239Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_115550__74100.077.97732[88, 458]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_115550__741.json62.5missing{\n "num_gpu": 99\n}missing
7240Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_115639__51500.048.55662[88, 283]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_115639__515.json62.5missing{\n "num_gpu": 99\n}missing
7241Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_151747__29700.065.21080[88, 384]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_151747__297.json50.0missing{\n "num_gpu": 99\n}missing
7242Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_151843__27610.055.88912[88, 328]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_151843__276.json67.5missing{\n "num_gpu": 99\n}missing
7243Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_115025__95000.034.56080[127, 194]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_115025__950.json0.0missing{\n "num_gpu": 99\n}missing
7244Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_115109__23400.043.43430[127, 248]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_115109__234.json0.0missing{\n "num_gpu": 99\n}missing
7245Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_115219__44100.069.81940[127, 407]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_115219__441.json0.0missing{\n "num_gpu": 99\n}missing
7246Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_151532__17000.044.44330[127, 253]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_151532__170.json0.0missing{\n "num_gpu": 99\n}missing
7247Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_151642__11200.069.93840[127, 406]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_151642__112.json50.0missing{\n "num_gpu": 99\n}missing
7248Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_114746__88700.068.37290[220, 355]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114746__887.json0.0missing{\n "num_gpu": 99\n}missing
7249Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_114844__26210.057.28171[220, 315]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114844__262.json61.25missing{\n "num_gpu": 99\n}missing
7250Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_114951__45600.066.67150[220, 371]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_114951__456.json50.0missing{\n "num_gpu": 99\n}missing
7251Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_151351__73400.038.48330[220, 201]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_151351__734.json0.0missing{\n "num_gpu": 99\n}missing
7252Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_151447__31110.056.48041[220, 309]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_151447__311.json61.25missing{\n "num_gpu": 99\n}missing
7253Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_120159__73710.077.14042[401, 396]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120159__737.json67.5missing{\n "num_gpu": 99\n}missing
7254Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_120354__64300.0114.770[401, 611]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120354__643.json50.0missing{\n "num_gpu": 99\n}missing
7255Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_120624__76700.0149.2290[401, 784]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120624__767.json25.0missing{\n "num_gpu": 99\n}missing
7256Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_152141__60100.042.44282[401, 191]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_152141__601.json62.5missing{\n "num_gpu": 99\n}missing
7257Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_152325__38700.0102.9840[401, 543]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_152325__387.json25.0missing{\n "num_gpu": 99\n}missing
7258Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_115749__85600.070.38880[399, 356]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_115749__856.json50.0missing{\n "num_gpu": 99\n}missing
7259Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_115926__77000.096.40950[399, 506]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_115926__770.json50.0missing{\n "num_gpu": 99\n}missing
7260Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_120041__76000.074.7562[399, 377]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_120041__760.json62.5missing{\n "num_gpu": 99\n}missing
7261Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_151945__89400.061.19680[399, 301]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_151945__894.json50.0missing{\n "num_gpu": 99\n}missing
7262Apple-MacBook-Pro-M1extract_julia_codenous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_152059__10800.073.87180[399, 374]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_152059__108.json50.0missing{\n "num_gpu": 99\n}missing
7263Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_150048__33200.011.77150[93, 294]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_150048__332.json0.0missing{\n "num_gpu": 99\n}missing
7264Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTtruetrue520231225_150055__96200.06.636060[93, 161]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_150055__962.json50.0missing{\n "num_gpu": 99\n}missing
7265Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_150030__86300.09.310860[96, 231]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_150030__863.json50.0missing{\n "num_gpu": 99\n}missing
7266Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_150036__82810.05.833281[96, 140]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_150036__828.json61.25missing{\n "num_gpu": 99\n}missing
7267Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_004032__56200.06.928050[96, 168]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_004032__562.json50.0missing{\n "num_gpu": 99\n}missing
7268Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_150013__53810.06.009081[137, 136]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_150013__538.json61.25missing{\n "num_gpu": 99\n}missing
7269Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_150021__17000.07.361750[137, 171]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_150021__170.json0.0missing{\n "num_gpu": 99\n}missing
7270Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_004025__65100.03.341531[137, 66]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_004025__651.json56.25missing{\n "num_gpu": 99\n}missing
7271Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_145951__41100.022.72070[231, 386]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145951__411.json25.0missing{\n "num_gpu": 99\n}missing
7272Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_150007__57600.016.12040[231, 379]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150007__576.json0.0missing{\n "num_gpu": 99\n}missing
7273Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_004021__95300.022.24070[231, 382]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004021__953.json50.0missing{\n "num_gpu": 99\n}missing
7274Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_150152__86810.031.63621[404, 725]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150152__868.json61.25missing{\n "num_gpu": 99\n}missing
7275Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_150208__85300.015.70940[404, 341]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150208__853.json50.0missing{\n "num_gpu": 99\n}missing
7276Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_004049__35510.09.989441[404, 198]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004049__355.json61.25missing{\n "num_gpu": 99\n}missing
7277Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_150109__87110.013.95121[402, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_150109__871.json61.25missing{\n "num_gpu": 99\n}missing
7278Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_150120__69700.011.14890[402, 228]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_150120__697.json0.0missing{\n "num_gpu": 99\n}missing
7279Apple-MacBook-Pro-M1extract_julia_codeopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_004038__97110.06.664671[402, 115]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_004038__971.json61.25missing{\n "num_gpu": 99\n}missing
7280Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_005952__15400.019.06390[72, 554]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_005952__154.json0.0missingmissingmissing
7281Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralAsIs1SHOTtruetrue520231225_140949__34100.09.000060[91, 288]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_140949__341.json50.0missing{\n "num_gpu": 99\n}missing
7282Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralAsIs1SHOTtruetrue520231225_140957__20910.08.276671[91, 265]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_140957__209.json61.25missing{\n "num_gpu": 99\n}missing
7283Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231214_005933__22500.014.77630[89, 433]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_005933__225.json50.0missingmissingmissing
7284Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_140931__36210.05.400411[94, 168]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_140931__362.json61.25missing{\n "num_gpu": 99\n}missing
7285Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_140939__87700.07.838580[94, 250]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_140939__877.json50.0missing{\n "num_gpu": 99\n}missing
7286Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralInJulia1SHOTtruetrue520231227_001824__18410.09.519022[94, 304]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_001824__184.json67.5missing{\n "num_gpu": 99\n}missing
7287Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_005918__87300.012.86750[118, 367]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_005918__873.json50.0missingmissingmissing
7288Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_140916__61500.011.40630[135, 357]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_140916__615.json50.0missing{\n "num_gpu": 99\n}missing
7289Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_140926__23210.09.270272[135, 288]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_140926__232.json67.5missing{\n "num_gpu": 99\n}missing
7290Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231227_001814__25700.011.07470[135, 345]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_001814__257.json0.0missing{\n "num_gpu": 99\n}missing
7291Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231214_005905__55400.028.47550[211, 746]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_005905__554.json50.0missingmissingmissing
7292Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_140900__65500.011.1890[229, 163]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140900__655.json50.0missing{\n "num_gpu": 99\n}missing
7293Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_140905__19710.04.735522[229, 121]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140905__197.json67.5missing{\n "num_gpu": 99\n}missing
7294Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_001803__28400.017.15150[229, 363]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001803__284.json50.0missing{\n "num_gpu": 99\n}missing
7295Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231214_010031__68300.023.93210[11, 639]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_010031__683.json50.0missingmissingmissing
7296Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_141031__22100.09.828920[402, 259]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141031__221.json25.0missing{\n "num_gpu": 99\n}missing
7297Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_141044__47500.012.52010[402, 344]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141044__475.json50.0missing{\n "num_gpu": 99\n}missing
7298Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231227_001839__34200.07.866780[402, 195]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001839__342.json0.0missing{\n "num_gpu": 99\n}missing
7299Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231214_010007__87600.015.35450[389, 327]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_010007__876.json0.0missingmissingmissing
7300Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_141013__40300.016.26720[400, 460]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_141013__403.json50.0missing{\n "num_gpu": 99\n}missing
7301Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_141021__98210.07.593332[400, 187]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_141021__982.json67.5missing{\n "num_gpu": 99\n}missing
7302Apple-MacBook-Pro-M1extract_julia_codeopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_001831__10100.07.158720[400, 172]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_001831__101.json50.0missing{\n "num_gpu": 99\n}missing
7303Apple-MacBook-Pro-M1extract_julia_codeorca2:13bAsIs1SHOTfalsefalse520231214_073037__28000.017.61490[72, 516]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__AsIs__1SHOT__20231214_073037__280.json0.0missingmissingmissing
7304Apple-MacBook-Pro-M1extract_julia_codeorca2:13bAsIs1SHOTfalsefalse520231225_143429__15800.016.6810[89, 302]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__AsIs__1SHOT__20231225_143429__158.json0.0missing{\n "num_gpu": 99\n}missing
7305Apple-MacBook-Pro-M1extract_julia_codeorca2:13bAsIs1SHOTfalsefalse520231225_143449__50400.019.27680[89, 351]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__AsIs__1SHOT__20231225_143449__504.json0.0missing{\n "num_gpu": 99\n}missing
7306Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231214_073019__50600.013.50430[89, 397]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231214_073019__506.json0.0missingmissingmissing
7307Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231225_143410__38900.03.404210[92, 50]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231225_143410__389.json0.0missing{\n "num_gpu": 99\n}missing
7308Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231225_143413__58800.02.512480[92, 33]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231225_143413__588.json0.0missing{\n "num_gpu": 99\n}missing
7309Apple-MacBook-Pro-M1extract_julia_codeorca2:13bInJulia1SHOTfalsefalse520231227_002707__69300.018.55310[92, 336]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__InJulia__1SHOT__20231227_002707__693.json0.0missing{\n "num_gpu": 99\n}missing
7310Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_073006__63700.06.613380[118, 182]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_073006__637.json50.0missingmissingmissing
7311Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_143356__39100.016.96530[131, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_143356__391.json0.0missing{\n "num_gpu": 99\n}missing
7312Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_143407__65900.010.57390[131, 178]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_143407__659.json0.0missing{\n "num_gpu": 99\n}missing
7313Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_002649__79800.013.02090[131, 223]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_002649__798.json0.0missing{\n "num_gpu": 99\n}missing
7314Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_072959__33300.019.70940[211, 522]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_072959__333.json50.0missingmissingmissing
7315Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_143331__93800.026.72650[224, 292]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143331__938.json0.0missing{\n "num_gpu": 99\n}missing
7316Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_143339__30200.07.844110[224, 115]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143339__302.json0.0missing{\n "num_gpu": 99\n}missing
7317Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231227_002636__14700.022.73310[224, 225]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002636__147.json0.0missing{\n "num_gpu": 99\n}missing
7318Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_073128__26700.021.15970[11, 568]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073128__267.json50.0missingmissingmissing
7319Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_143640__34600.08.026870[395, 87]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143640__346.json0.0missing{\n "num_gpu": 99\n}missing
7320Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_143724__33400.044.38760[395, 721]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143724__334.json0.0missing{\n "num_gpu": 99\n}missing
7321Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_002740__97200.08.043790[395, 87]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002740__972.json0.0missing{\n "num_gpu": 99\n}missing
7322Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTfalsefalse520231214_073107__58600.029.95430[389, 700]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_073107__586.json0.0missingmissingmissing
7323Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTtruetrue520231225_143552__98700.063.45080[392, 1029]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_143552__987.json50.0missing{\n "num_gpu": 99\n}missing
7324Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_143632__21500.039.70040[392, 643]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_143632__215.json0.0missing{\n "num_gpu": 99\n}missing
7325Apple-MacBook-Pro-M1extract_julia_codeorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_002732__60500.025.03420[392, 390]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_002732__605.json0.0missing{\n "num_gpu": 99\n}missing
7326Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_150324__33000.016.73480[80, 637]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_150324__330.json0.0missing{\n "num_gpu": 99\n}missing
7327Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_150359__31000.035.06370[80, 1258]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_150359__310.json0.0missing{\n "num_gpu": 99\n}missing
7328Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_150239__42700.01.44930[83, 49]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_150239__427.json0.0missing{\n "num_gpu": 99\n}missing
7329Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_150308__65600.028.92370[83, 1058]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_150308__656.json0.0missing{\n "num_gpu": 99\n}missing
7330Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_004118__76000.021.31840[83, 793]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_004118__760.json0.0missing{\n "num_gpu": 99\n}missing
7331Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_150234__96700.017.36130[120, 651]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_150234__967.json0.0missing{\n "num_gpu": 99\n}missing
7332Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_150237__40900.03.141710[120, 113]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_150237__409.json0.0missing{\n "num_gpu": 99\n}missing
7333Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_004057__39600.03.349530[120, 121]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_004057__396.json0.0missing{\n "num_gpu": 99\n}missing
7334Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231225_150212__12200.04.733620[211, 16]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150212__122.json50.0missing{\n "num_gpu": 99\n}missing
7335Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231225_150217__45400.04.185410[211, 140]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150217__454.json50.0missing{\n "num_gpu": 99\n}missing
7336Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_004053__29700.04.668740[211, 15]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004053__297.json0.0missing{\n "num_gpu": 99\n}missing
7337Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_150427__59700.04.629010[372, 131]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150427__597.json0.0missing{\n "num_gpu": 99\n}missing
7338Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_150445__53400.017.34850[372, 589]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150445__534.json0.0missing{\n "num_gpu": 99\n}missing
7339Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_004126__60100.05.378210[372, 158]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004126__601.json0.0missing{\n "num_gpu": 99\n}missing
7340Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_150406__69000.07.049640[369, 222]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_150406__690.json0.0missing{\n "num_gpu": 99\n}missing
7341Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_150423__57000.016.1910[369, 549]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_150423__570.json0.0missing{\n "num_gpu": 99\n}missing
7342Apple-MacBook-Pro-M1extract_julia_codephi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_004120__55500.02.072080[369, 33]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_004120__555.json0.0missing{\n "num_gpu": 99\n}missing
7343Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_073209__93100.015.01530[72, 442]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_073209__931.json0.0missingmissingmissing
7344Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2AsIs1SHOTtruetrue520231225_144126__42210.038.04271[97, 290]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_144126__422.json61.25missing{\n "num_gpu": 99\n}missing
7345Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_144204__73500.038.33230[97, 292]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_144204__735.json0.0missing{\n "num_gpu": 99\n}missing
7346Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231214_073154__46300.010.81790[89, 319]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_073154__463.json50.0missingmissingmissing
7347Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231225_144014__99110.033.20641[100, 251]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_144014__991.json61.25missing{\n "num_gpu": 99\n}missing
7348Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231225_144048__25910.033.37431[100, 252]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_144048__259.json61.25missing{\n "num_gpu": 99\n}missing
7349Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2InJulia1SHOTtruetrue520231227_003000__60410.040.40341[100, 305]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_003000__604.json61.25missing{\n "num_gpu": 99\n}missing
7350Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_073143__20900.03.305410[118, 79]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_073143__209.json50.0missingmissingmissing
7351Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_143912__77010.019.24351[139, 132]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_143912__770.json61.25missing{\n "num_gpu": 99\n}missing
7352Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_143940__48110.027.74331[139, 201]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_143940__481.json61.25missing{\n "num_gpu": 99\n}missing
7353Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_002920__10310.044.76491[139, 335]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_002920__103.json61.25missing{\n "num_gpu": 99\n}missing
7354Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_073140__17800.011.39370[211, 293]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073140__178.json0.0missingmissingmissing
7355Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_143812__98710.047.85221[232, 168]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143812__987.json61.25missing{\n "num_gpu": 99\n}missing
7356Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231225_143853__61500.040.72080[232, 287]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143853__615.json0.0missing{\n "num_gpu": 99\n}missing
7357Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_002835__25710.054.5021[232, 229]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002835__257.json61.25missing{\n "num_gpu": 99\n}missing
7358Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_073233__39800.02.931570[11, 78]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073233__398.json0.0missingmissingmissing
7359Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231225_144412__44500.041.8930[403, 266]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_144412__445.json25.0missing{\n "num_gpu": 99\n}missing
7360Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_144439__57810.025.92371[403, 140]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_144439__578.json61.25missing{\n "num_gpu": 99\n}missing
7361Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_003148__68810.042.99061[403, 272]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003148__688.json61.25missing{\n "num_gpu": 99\n}missing
7362Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_073230__60500.021.22640[389, 483]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_073230__605.json50.0missingmissingmissing
7363Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_144248__50610.043.61091[400, 278]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_144248__506.json61.25missing{\n "num_gpu": 99\n}missing
7364Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_144330__53710.042.19531[400, 267]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_144330__537.json61.25missing{\n "num_gpu": 99\n}missing
7365Apple-MacBook-Pro-M1extract_julia_codephind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_003105__20710.063.63831[400, 430]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_003105__207.json61.25missing{\n "num_gpu": 99\n}missing
7366Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_235050__47400.011.28010[72, 336]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_235050__474.json0.0missingmissingmissing
7367Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231219_235104__39300.014.30460[1, 439]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_235104__393.json0.0missingmissingmissing
7368Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTtruetrue520231219_235123__85300.018.75440[1, 564]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231219_235123__853.json50.0missingmissingmissing
7369Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_145549__97600.018.84720[93, 318]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_145549__976.json0.0missing{\n "num_gpu": 99\n}missing
7370Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_145611__77100.021.95530[93, 372]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_145611__771.json0.0missing{\n "num_gpu": 99\n}missing
7371Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231219_235031__34600.09.655950[1, 303]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_235031__346.json50.0missingmissingmissing
7372Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231219_235039__25800.07.681420[1, 244]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231219_235039__258.json25.0missingmissingmissing
7373Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_145513__47300.014.2030[96, 238]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_145513__473.json50.0missing{\n "num_gpu": 99\n}missing
7374Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_145530__52000.015.99890[96, 269]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_145530__520.json50.0missing{\n "num_gpu": 99\n}missing
7375Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_003826__82000.017.4850[96, 294]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_003826__820.json50.0missing{\n "num_gpu": 99\n}missing
7376Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231219_235003__77100.02.111320[1, 68]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_235003__771.json25.0missingmissingmissing
7377Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231219_235010__99300.07.557180[1, 237]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231219_235010__993.json50.0missingmissingmissing
7378Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_145439__65800.012.4310[137, 198]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145439__658.json0.0missing{\n "num_gpu": 99\n}missing
7379Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_145459__96400.019.94620[137, 328]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_145459__964.json0.0missing{\n "num_gpu": 99\n}missing
7380Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_003808__45210.014.6621[137, 236]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_003808__452.json61.25missing{\n "num_gpu": 99\n}missing
7381Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231219_234940__38400.015.28120[1, 447]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234940__384.json0.0missingmissingmissing
7382Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231219_234955__10200.015.47670[1, 453]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231219_234955__102.json50.0missingmissingmissing
7383Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_145411__59200.021.79870[231, 189]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145411__592.json0.0missing{\n "num_gpu": 99\n}missing
7384Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_145427__82200.015.91720[231, 243]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_145427__822.json50.0missing{\n "num_gpu": 99\n}missing
7385Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_003754__85200.022.90930[231, 214]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_003754__852.json0.0missing{\n "num_gpu": 99\n}missing
7386Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231219_235249__93100.019.18120[1, 525]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_235249__931.json50.0missingmissingmissing
7387Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231219_235303__30800.014.06710[1, 393]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231219_235303__308.json0.0missingmissingmissing
7388Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_145702__54000.017.02270[404, 236]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145702__540.json0.0missing{\n "num_gpu": 99\n}missing
7389Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_145720__15800.018.02150[404, 253]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_145720__158.json0.0missing{\n "num_gpu": 99\n}missing
7390Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_003904__26100.015.73650[404, 214]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_003904__261.json50.0missing{\n "num_gpu": 99\n}missing
7391Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231219_235158__20900.014.69190[1, 410]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_235158__209.json50.0missingmissingmissing
7392Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231219_235211__19200.013.64350[1, 382]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231219_235211__192.json0.0missingmissingmissing
7393Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_145631__98600.020.15740[402, 289]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145631__986.json50.0missing{\n "num_gpu": 99\n}missing
7394Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_145645__89600.014.32530[402, 191]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_145645__896.json0.0missing{\n "num_gpu": 99\n}missing
7395Apple-MacBook-Pro-M1extract_julia_codesolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_003848__49810.021.85032[402, 316]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_003848__498.json67.5missing{\n "num_gpu": 99\n}missing
7396Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrAsIs1SHOTfalsefalse520231214_072853__95100.014.45830[72, 427]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_072853__951.json0.0missingmissingmissing
7397Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrAsIs1SHOTfalsefalse520231225_143213__12100.010.03450[93, 560]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_143213__121.json0.0missing{\n "num_gpu": 99\n}missing
7398Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrAsIs1SHOTfalsefalse520231225_143220__88800.06.654030[93, 377]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_143220__888.json0.0missing{\n "num_gpu": 99\n}missing
7399Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231214_072838__34100.012.04890[89, 356]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_072838__341.json0.0missingmissingmissing
7400Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231225_143156__21600.04.265770[96, 242]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_143156__216.json0.0missing{\n "num_gpu": 99\n}missing
7401Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231225_143203__13300.07.393670[96, 418]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_143203__133.json0.0missing{\n "num_gpu": 99\n}missing
7402Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrInJulia1SHOTfalsefalse520231227_002553__69200.08.278990[96, 462]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_002553__692.json0.0missing{\n "num_gpu": 99\n}missing
7403Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_072826__70200.011.2150[118, 320]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_072826__702.json0.0missingmissingmissing
7404Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_143146__33700.07.474730[133, 411]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_143146__337.json0.0missing{\n "num_gpu": 99\n}missing
7405Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_143151__76600.05.363060[133, 292]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_143151__766.json0.0missing{\n "num_gpu": 99\n}missing
7406Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_002544__55800.06.102560[133, 332]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_002544__558.json0.0missing{\n "num_gpu": 99\n}missing
7407Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231214_072815__28400.010.91110[211, 279]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_072815__284.json0.0missingmissingmissing
7408Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_143131__46800.013.43350[221, 551]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143131__468.json0.0missing{\n "num_gpu": 99\n}missing
7409Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231225_143138__78100.06.936610[221, 360]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_143138__781.json50.0missing{\n "num_gpu": 99\n}missing
7410Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_002538__50900.08.483540[221, 299]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002538__509.json0.0missing{\n "num_gpu": 99\n}missing
7411Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231214_072939__33300.015.82750[11, 432]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_072939__333.json50.0missingmissingmissing
7412Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_143259__10100.02.474090[383, 78]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143259__101.json0.0missing{\n "num_gpu": 99\n}missing
7413Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_143305__98400.05.95770[383, 265]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_143305__984.json0.0missing{\n "num_gpu": 99\n}missing
7414Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_002613__26900.011.53030[383, 540]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002613__269.json0.0missing{\n "num_gpu": 99\n}missing
7415Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231214_072923__93600.030.33480[389, 709]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_072923__936.json0.0missingmissingmissing
7416Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_143233__16200.013.40470[381, 633]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_143233__162.json0.0missing{\n "num_gpu": 99\n}missing
7417Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_143256__50500.023.08240[381, 1064]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_143256__505.json0.0missing{\n "num_gpu": 99\n}missing
7418Apple-MacBook-Pro-M1extract_julia_codestablelm-zephyrJuliaRecapTask1SHOTtruefalse520231227_002602__16000.08.990960[381, 417]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_002602__160.json25.0missing{\n "num_gpu": 99\n}missing
7419Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestAsIs1SHOTfalsefalse520231214_010124__28700.015.93980[72, 469]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_010124__287.json0.0missingmissingmissing
7420Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestAsIs1SHOTtruefalse520231225_141218__15900.013.48490[93, 435]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_141218__159.json25.0missing{\n "num_gpu": 99\n}missing
7421Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestAsIs1SHOTtruetrue520231225_141230__43610.012.35231[93, 398]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_141230__436.json61.25missing{\n "num_gpu": 99\n}missing
7422Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTfalsefalse520231214_010108__13200.011.52490[89, 340]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_010108__132.json0.0missingmissingmissing
7423Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruetrue520231225_141151__70310.016.06431[96, 519]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_141151__703.json61.25missing{\n "num_gpu": 99\n}missing
7424Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruetrue520231225_141204__29810.012.75571[96, 411]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_141204__298.json61.25missing{\n "num_gpu": 99\n}missing
7425Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestInJulia1SHOTtruetrue520231227_001917__85710.011.07731[96, 354]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_001917__857.json61.25missing{\n "num_gpu": 99\n}missing
7426Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_010056__23700.010.95060[118, 312]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_010056__237.json50.0missingmissingmissing
7427Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_141127__71400.08.594770[137, 262]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_141127__714.json50.0missing{\n "num_gpu": 99\n}missing
7428Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_141135__46010.07.992331[137, 244]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_141135__460.json61.25missing{\n "num_gpu": 99\n}missing
7429Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_001906__24610.05.886161[137, 174]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_001906__246.json61.25missing{\n "num_gpu": 99\n}missing
7430Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_010045__95500.013.91540[211, 362]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_010045__955.json0.0missingmissingmissing
7431Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_141107__38500.023.5480[231, 554]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141107__385.json50.0missing{\n "num_gpu": 99\n}missing
7432Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_141118__41610.010.4231[231, 306]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141118__416.json61.25missing{\n "num_gpu": 99\n}missing
7433Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231227_001900__32800.020.76680[231, 470]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_001900__328.json0.0missing{\n "num_gpu": 99\n}missing
7434Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231214_010157__73600.013.9550[11, 383]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_010157__736.json25.0missingmissingmissing
7435Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231225_141313__68300.09.019120[404, 232]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141313__683.json25.0missing{\n "num_gpu": 99\n}missing
7436Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_141331__95200.018.24880[404, 519]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_141331__952.json50.0missing{\n "num_gpu": 99\n}missing
7437Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_001935__14010.08.552341[404, 216]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_001935__140.json61.25missing{\n "num_gpu": 99\n}missing
7438Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_010143__23000.019.15730[389, 432]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_010143__230.json50.0missingmissingmissing
7439Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_141245__68310.014.61312[402, 409]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_141245__683.json67.5missing{\n "num_gpu": 99\n}missing
7440Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231225_141304__33100.018.76930[402, 536]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_141304__331.json0.0missing{\n "num_gpu": 99\n}missing
7441Apple-MacBook-Pro-M1extract_julia_codestarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_001927__73800.09.82461[402, 256]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_001927__738.json56.25missing{\n "num_gpu": 99\n}missing
7442Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatAsIs1SHOTfalsefalse520231214_010306__87700.027.98120[72, 356]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_010306__877.json0.0missingmissingmissing
7443Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatAsIs1SHOTfalsefalse520231225_141934__19800.060.96920[85, 461]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_141934__198.json0.0missing{\n "num_gpu": 99\n}missing
7444Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatAsIs1SHOTfalsefalse520231225_142014__96400.039.75390[85, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_142014__964.json0.0missing{\n "num_gpu": 99\n}missing
7445Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231214_010238__24700.014.21070[89, 419]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_010238__247.json50.0missingmissingmissing
7446Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231225_141657__15300.059.11452[88, 447]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_141657__153.json62.5missing{\n "num_gpu": 99\n}missing
7447Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231225_141833__60310.096.29792[88, 724]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_141833__603.json67.5missing{\n "num_gpu": 99\n}missing
7448Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatInJulia1SHOTtruetrue520231227_002143__69500.041.90311[88, 313]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_002143__695.json56.25missing{\n "num_gpu": 99\n}missing
7449Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_010224__74900.09.715780[118, 276]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_010224__749.json50.0missingmissingmissing
7450Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_141504__47910.030.44122[127, 220]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_141504__479.json67.5missing{\n "num_gpu": 99\n}missing
7451Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_141557__14500.053.71422[127, 399]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_141557__145.json62.5missing{\n "num_gpu": 99\n}missing
7452Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_002101__13510.029.02212[127, 208]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_002101__135.json67.5missing{\n "num_gpu": 99\n}missing
7453Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_010214__36200.017.30040[211, 458]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_010214__362.json50.0missingmissingmissing
7454Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231225_141401__48000.029.23890[220, 8]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141401__480.json0.0missing{\n "num_gpu": 99\n}missing
7455Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_141433__23810.032.47721[220, 218]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_141433__238.json61.25missing{\n "num_gpu": 99\n}missing
7456Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231227_002032__81600.055.99830[220, 226]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_002032__816.json50.0missing{\n "num_gpu": 99\n}missing
7457Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_010612__55800.0120.5550[11, 863]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_010612__558.json0.0missingmissingmissing
7458Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_142253__53200.056.54150[401, 363]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142253__532.json50.0missing{\n "num_gpu": 99\n}missing
7459Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_142347__63900.054.50992[401, 348]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_142347__639.json62.5missing{\n "num_gpu": 99\n}missing
7460Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231227_002307__79000.028.53032[401, 153]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_002307__790.json62.5missing{\n "num_gpu": 99\n}missing
7461Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_010411__87310.065.07080[389, 444]0.10.0-DEV41.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_010411__873.json55.0missingmissingmissing
7462Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_142102__32110.047.80972[399, 298]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_142102__321.json67.5missing{\n "num_gpu": 99\n}missing
7463Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_142156__89510.053.99882[399, 344]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_142156__895.json67.5missing{\n "num_gpu": 99\n}missing
7464Apple-MacBook-Pro-M1extract_julia_codeyi:34b-chatJuliaRecapTask1SHOTtruetrue520231227_002239__58500.055.74340[399, 356]0.10.0-DEV41.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/extract_julia_code/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_002239__585.json50.0missing{\n "num_gpu": 99\n}missing
7465Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructAsIs1SHOTfalsefalse520231214_074042__29300.016.05390[96, 466]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_074042__293.json0.0missingmissingmissing
7466Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructAsIs1SHOTtruefalse520231225_152301__38200.09.089990[118, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_152301__382.json25.0missing{\n "num_gpu": 99\n}missing
7467Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructAsIs1SHOTfalsefalse520231225_152318__52000.017.77840[118, 319]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_152318__520.json0.0missing{\n "num_gpu": 99\n}missing
7468Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTfalsefalse520231214_074026__80500.015.15380[113, 435]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_074026__805.json0.0missingmissingmissing
7469Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTfalsefalse520231225_152232__73800.018.81360[121, 338]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_152232__738.json0.0missing{\n "num_gpu": 99\n}missing
7470Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTtruetrue520231225_152251__70950.019.57044[121, 351]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_152251__709.json100.0missing{\n "num_gpu": 99\n}missing
7471Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructInJulia1SHOTtruetrue520231227_005253__89250.020.99754[121, 377]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_005253__892.json100.0missing{\n "num_gpu": 99\n}missing
7472Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231214_074010__61800.013.8840[142, 388]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_074010__618.json25.0missingmissingmissing
7473Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_152210__50500.05.042980[159, 72]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_152210__505.json0.0missing{\n "num_gpu": 99\n}missing
7474Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_152213__91900.02.859830[159, 30]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_152213__919.json0.0missing{\n "num_gpu": 99\n}missing
7475Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_005232__40240.015.40563[159, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_005232__402.json88.75missing{\n "num_gpu": 99\n}missing
7476Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231214_073957__30200.018.45130[217, 486]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073957__302.json25.0missingmissingmissing
7477Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_152150__95850.027.71094[235, 299]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152150__958.json100.0missing{\n "num_gpu": 99\n}missing
7478Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_152205__27450.015.11124[235, 246]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152205__274.json100.0missing{\n "num_gpu": 99\n}missing
7479Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_005216__62850.024.51384[235, 246]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005216__628.json100.0missing{\n "num_gpu": 99\n}missing
7480Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231214_074131__41800.027.6130[11, 720]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074131__418.json0.0missingmissingmissing
7481Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_152412__93550.023.9754[424, 369]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152412__935.json100.0missing{\n "num_gpu": 99\n}missing
7482Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231225_152423__70800.010.81930[424, 134]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152423__708.json0.0missing{\n "num_gpu": 99\n}missing
7483Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_005322__40050.013.16474[424, 176]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005322__400.json100.0missing{\n "num_gpu": 99\n}missing
7484Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231214_074104__20200.022.02550[413, 494]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_074104__202.json25.0missingmissingmissing
7485Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_152334__24100.015.78360[421, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_152334__241.json50.0missing{\n "num_gpu": 99\n}missing
7486Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_152348__21930.014.08774[421, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_152348__219.json90.0missing{\n "num_gpu": 99\n}missing
7487Apple-MacBook-Pro-M1ispersonalcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_005308__28440.015.50773[421, 218]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_005308__284.json88.75missing{\n "num_gpu": 99\n}missing
7488NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_014922__57750.05.53774[0, 415]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_014922__577.json100.0missing{\n "num_gpu": 99\n}missing
7489NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_014926__43540.03.539813[0, 264]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_014926__435.json88.75missing{\n "num_gpu": 99\n}missing
7490NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_014929__11850.03.364194[0, 242]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_014929__118.json100.0missing{\n "num_gpu": 99\n}missing
7491NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_014934__78250.04.484044[0, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_014934__782.json100.0missing{\n "num_gpu": 99\n}missing
7492NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_014938__77900.04.330740[0, 310]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_014938__779.json50.0missing{\n "num_gpu": 99\n}missing
7493NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_014845__85500.03.034670[0, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_014845__855.json25.0missing{\n "num_gpu": 99\n}missing
7494NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_014847__12850.02.546874[0, 184]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_014847__128.json100.0missing{\n "num_gpu": 99\n}missing
7495NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_014851__55450.03.511294[0, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_014851__554.json100.0missing{\n "num_gpu": 99\n}missing
7496NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_014853__76230.02.012664[0, 145]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_014853__762.json90.0missing{\n "num_gpu": 99\n}missing
7497NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_014857__48150.03.656744[0, 261]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_014857__481.json100.0missing{\n "num_gpu": 99\n}missing
7498NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_014819__51330.01.451744[0, 106]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014819__513.json90.0missing{\n "num_gpu": 99\n}missing
7499NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_014821__79900.02.581160[0, 188]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014821__799.json25.0missing{\n "num_gpu": 99\n}missing
7500NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_014826__55950.04.739384[0, 343]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014826__559.json100.0missing{\n "num_gpu": 99\n}missing
7501NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_014829__18530.02.865564[0, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014829__185.json90.0missing{\n "num_gpu": 99\n}missing
7502NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_014831__36900.01.284950[0, 94]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014831__369.json25.0missing{\n "num_gpu": 99\n}missing
7503NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_015036__52800.03.14250[0, 226]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015036__528.json0.0missing{\n "num_gpu": 99\n}missing
7504NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015037__68100.00.5565890[0, 40]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015037__681.json25.0missing{\n "num_gpu": 99\n}missing
7505NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015040__44600.02.742270[0, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015040__446.json25.0missing{\n "num_gpu": 99\n}missing
7506NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015044__70900.04.157690[0, 298]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015044__709.json25.0missing{\n "num_gpu": 99\n}missing
7507NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015046__61400.01.947990[0, 140]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015046__614.json25.0missing{\n "num_gpu": 99\n}missing
7508NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_015003__17040.05.335863[0, 383]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015003__170.json88.75missing{\n "num_gpu": 99\n}missing
7509NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_015006__81930.02.869484[0, 206]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015006__819.json90.0missing{\n "num_gpu": 99\n}missing
7510NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_015008__26900.01.725770[0, 124]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015008__269.json25.0missing{\n "num_gpu": 99\n}missing
7511NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_015015__46300.06.796480[0, 482]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015015__463.json50.0missing{\n "num_gpu": 99\n}missing
7512NVIDIA-RTX-4090-4xispersonalcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_015017__43600.02.752520[0, 198]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015017__436.json25.0missing{\n "num_gpu": 99\n}missing
7513Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonAsIs1SHOTfalsefalse520231214_074230__89400.013.46730[96, 391]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_074230__894.json0.0missingmissingmissing
7514Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonAsIs1SHOTfalsefalse520231225_152515__53700.06.146090[92, 103]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_152515__537.json0.0missing{\n "num_gpu": 99\n}missing
7515Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonAsIs1SHOTfalsefalse520231225_152527__92100.012.42850[92, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_152527__921.json0.0missing{\n "num_gpu": 99\n}missing
7516Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonInJulia1SHOTtruefalse520231214_074216__43600.017.28760[113, 495]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_074216__436.json25.0missingmissingmissing
7517Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonInJulia1SHOTfalsefalse520231225_152504__16200.011.48870[95, 206]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_152504__162.json0.0missing{\n "num_gpu": 99\n}missing
7518Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonInJulia1SHOTfalsefalse520231225_152509__89500.04.531520[95, 72]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_152509__895.json0.0missing{\n "num_gpu": 99\n}missing
7519Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_074159__22300.010.18010[142, 281]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_074159__223.json0.0missingmissingmissing
7520Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse520231225_152443__98000.04.037240[96, 63]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_152443__980.json25.0missing{\n "num_gpu": 99\n}missing
7521Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_152452__43500.09.605430[96, 170]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_152452__435.json0.0missing{\n "num_gpu": 99\n}missing
7522Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruefalse520231214_074148__87100.017.03360[217, 448]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074148__871.json25.0missingmissingmissing
7523Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_152436__61300.012.92160[110, 37]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152436__613.json0.0missing{\n "num_gpu": 99\n}missing
7524Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_152439__37000.02.536890[110, 29]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152439__370.json0.0missing{\n "num_gpu": 99\n}missing
7525Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231214_074338__46100.017.56130[11, 474]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074338__461.json25.0missingmissingmissing
7526Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_152541__38000.01.557490[113, 10]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152541__380.json0.0missing{\n "num_gpu": 99\n}missing
7527Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_152547__59000.06.155180[113, 99]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152547__590.json0.0missing{\n "num_gpu": 99\n}missing
7528Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231214_074321__90100.051.15920[413, 1166]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_074321__901.json25.0missingmissingmissing
7529Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_152533__49300.06.041380[110, 97]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_152533__493.json0.0missing{\n "num_gpu": 99\n}missing
7530Apple-MacBook-Pro-M1ispersonalcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_152539__66000.06.1270[110, 99]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_152539__660.json0.0missing{\n "num_gpu": 99\n}missing
7531NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_015623__57800.03.978280[0, 144]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015623__578.json25.0missing{\n "num_gpu": 99\n}missing
7532NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_015629__17400.06.227860[0, 225]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015629__174.json25.0missing{\n "num_gpu": 99\n}missing
7533NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_015635__74750.06.085434[0, 220]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015635__747.json100.0missing{\n "num_gpu": 99\n}missing
7534NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_015641__73000.05.864110[0, 212]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015641__730.json50.0missing{\n "num_gpu": 99\n}missing
7535NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_015650__64700.08.482780[0, 306]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015650__647.json25.0missing{\n "num_gpu": 99\n}missing
7536NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_015523__58100.09.898150[0, 356]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015523__581.json50.0missing{\n "num_gpu": 99\n}missing
7537NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_015530__75700.06.747410[0, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015530__757.json25.0missing{\n "num_gpu": 99\n}missing
7538NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_015537__88600.07.112310[0, 256]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015537__886.json25.0missing{\n "num_gpu": 99\n}missing
7539NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_015540__95600.02.818580[0, 102]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015540__956.json25.0missing{\n "num_gpu": 99\n}missing
7540NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_015547__80000.07.812080[0, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015547__800.json50.0missing{\n "num_gpu": 99\n}missing
7541NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_015420__69250.09.799394[0, 346]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015420__692.json100.0missing{\n "num_gpu": 99\n}missing
7542NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_015429__57150.09.291884[0, 328]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015429__571.json100.0missing{\n "num_gpu": 99\n}missing
7543NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_015438__38900.08.921120[0, 315]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015438__389.json25.0missing{\n "num_gpu": 99\n}missing
7544NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_015445__27100.06.733640[0, 238]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015445__271.json25.0missing{\n "num_gpu": 99\n}missing
7545NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_015450__33600.04.721680[0, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015450__336.json25.0missing{\n "num_gpu": 99\n}missing
7546NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015902__52200.012.01730[0, 419]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015902__522.json25.0missing{\n "num_gpu": 99\n}missing
7547NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015927__57400.024.79580[0, 866]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015927__574.json25.0missing{\n "num_gpu": 99\n}missing
7548NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015934__59300.07.377380[0, 262]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015934__593.json25.0missing{\n "num_gpu": 99\n}missing
7549NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015944__47800.09.679320[0, 344]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015944__478.json25.0missing{\n "num_gpu": 99\n}missing
7550NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015953__39800.08.928720[0, 317]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015953__398.json25.0missing{\n "num_gpu": 99\n}missing
7551NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_015744__34100.04.612440[0, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015744__341.json0.0missing{\n "num_gpu": 99\n}missing
7552NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_015748__63600.03.350160[0, 118]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015748__636.json0.0missing{\n "num_gpu": 99\n}missing
7553NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_015805__11500.017.50260[0, 611]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015805__115.json0.0missing{\n "num_gpu": 99\n}missing
7554NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_015810__82000.04.667170[0, 164]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015810__820.json25.0missing{\n "num_gpu": 99\n}missing
7555NVIDIA-RTX-4090-4xispersonalcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_015821__26600.011.34790[0, 397]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015821__266.json0.0missing{\n "num_gpu": 99\n}missing
7556NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_014325__39500.010.78330[0, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_014325__395.json0.0missing{\n "num_gpu": 99\n}missing
7557NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_014333__11600.08.69180[0, 214]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_014333__116.json0.0missing{\n "num_gpu": 99\n}missing
7558NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_014340__29200.06.324630[0, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_014340__292.json0.0missing{\n "num_gpu": 99\n}missing
7559NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_014346__57800.06.607770[0, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_014346__578.json0.0missing{\n "num_gpu": 99\n}missing
7560NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_014359__78050.012.2544[0, 301]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_014359__780.json100.0missing{\n "num_gpu": 99\n}missing
7561NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruefalse520240201_014156__32300.014.21510[0, 345]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_014156__323.json25.0missing{\n "num_gpu": 99\n}missing
7562NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_014159__87000.02.564070[0, 62]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_014159__870.json0.0missing{\n "num_gpu": 99\n}missing
7563NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_014206__78900.06.961330[0, 169]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_014206__789.json0.0missing{\n "num_gpu": 99\n}missing
7564NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_014216__82700.010.52810[0, 256]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_014216__827.json0.0missing{\n "num_gpu": 99\n}missing
7565NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_014231__48950.015.19964[0, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_014231__489.json100.0missing{\n "num_gpu": 99\n}missing
7566NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_013952__71300.07.722960[0, 189]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_013952__713.json0.0missing{\n "num_gpu": 99\n}missing
7567NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruefalse520240201_014004__40400.011.31420[0, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014004__404.json25.0missing{\n "num_gpu": 99\n}missing
7568NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_014012__35950.08.247544[0, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014012__359.json100.0missing{\n "num_gpu": 99\n}missing
7569NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_014026__30700.013.80550[0, 337]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014026__307.json0.0missing{\n "num_gpu": 99\n}missing
7570NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_014034__95800.08.571930[0, 210]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_014034__958.json0.0missing{\n "num_gpu": 99\n}missing
7571NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_014716__83200.05.267170[0, 128]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_014716__832.json0.0missing{\n "num_gpu": 99\n}missing
7572NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_014729__45500.013.50690[0, 326]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_014729__455.json0.0missing{\n "num_gpu": 99\n}missing
7573NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_014734__18200.04.810470[0, 117]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_014734__182.json0.0missing{\n "num_gpu": 99\n}missing
7574NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_014745__44240.010.36883[0, 251]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_014745__442.json88.75missing{\n "num_gpu": 99\n}missing
7575NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_014755__25400.010.29230[0, 249]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_014755__254.json0.0missing{\n "num_gpu": 99\n}missing
7576NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_014521__65650.017.44034[0, 421]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_014521__656.json100.0missing{\n "num_gpu": 99\n}missing
7577NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_014532__90250.011.28484[0, 273]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_014532__902.json100.0missing{\n "num_gpu": 99\n}missing
7578NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruefalse520240201_014541__74000.08.878910[0, 215]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_014541__740.json25.0missing{\n "num_gpu": 99\n}missing
7579NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_014601__93200.019.66250[0, 469]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_014601__932.json0.0missing{\n "num_gpu": 99\n}missing
7580NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_014614__29650.013.06334[0, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_014614__296.json100.0missing{\n "num_gpu": 99\n}missing
7581NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_013119__84800.015.99420[0, 299]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_013119__848.json25.0missing{\n "num_gpu": 99\n}missing
7582NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_013124__11200.05.1710[0, 97]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_013124__112.json0.0missing{\n "num_gpu": 99\n}missing
7583NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_013138__26050.013.41124[0, 251]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_013138__260.json100.0missing{\n "num_gpu": 99\n}missing
7584NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_013154__98850.016.84694[0, 315]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_013154__988.json100.0missing{\n "num_gpu": 99\n}missing
7585NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_013212__75400.017.54870[0, 328]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_013212__754.json25.0missing{\n "num_gpu": 99\n}missing
7586NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012851__28750.024.00454[0, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012851__287.json100.0missing{\n "num_gpu": 99\n}missing
7587NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_012854__59900.02.674190[0, 50]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012854__599.json0.0missing{\n "num_gpu": 99\n}missing
7588NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012916__82950.021.99974[0, 408]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012916__829.json100.0missing{\n "num_gpu": 99\n}missing
7589NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_012924__44450.08.395674[0, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012924__444.json100.0missing{\n "num_gpu": 99\n}missing
7590NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_012937__21700.012.82920[0, 238]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_012937__217.json0.0missing{\n "num_gpu": 99\n}missing
7591NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012622__84000.010.66470[0, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012622__840.json0.0missing{\n "num_gpu": 99\n}missing
7592NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012634__51500.011.4170[0, 211]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012634__515.json0.0missing{\n "num_gpu": 99\n}missing
7593NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_012642__73040.08.22653[0, 152]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012642__730.json88.75missing{\n "num_gpu": 99\n}missing
7594NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_012653__97900.010.87190[0, 201]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012653__979.json0.0missing{\n "num_gpu": 99\n}missing
7595NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_012704__88650.011.14794[0, 206]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_012704__886.json100.0missing{\n "num_gpu": 99\n}missing
7596NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_013644__22450.034.05294[0, 624]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_013644__224.json100.0missing{\n "num_gpu": 99\n}missing
7597NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_013702__83200.017.78940[0, 328]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_013702__832.json25.0missing{\n "num_gpu": 99\n}missing
7598NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_013722__34950.020.51734[0, 378]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_013722__349.json100.0missing{\n "num_gpu": 99\n}missing
7599NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_013741__76150.019.15154[0, 352]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_013741__761.json100.0missing{\n "num_gpu": 99\n}missing
7600NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_013753__69900.011.70650[0, 216]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_013753__699.json0.0missing{\n "num_gpu": 99\n}missing
7601NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_013348__81350.028.80984[0, 529]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_013348__813.json100.0missing{\n "num_gpu": 99\n}missing
7602NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_013406__36050.017.7644[0, 325]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_013406__360.json100.0missing{\n "num_gpu": 99\n}missing
7603NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_013418__56300.012.54340[0, 230]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_013418__563.json0.0missing{\n "num_gpu": 99\n}missing
7604NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_013432__15750.013.35944[0, 245]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_013432__157.json100.0missing{\n "num_gpu": 99\n}missing
7605NVIDIA-RTX-4090-4xispersonalcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_013447__59600.015.56550[0, 285]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_013447__596.json0.0missing{\n "num_gpu": 99\n}missing
7606NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_015143__55800.03.372130[0, 403]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015143__558.json50.0missing{\n "num_gpu": 99\n}missing
7607NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_015145__61000.01.712750[0, 206]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015145__610.json25.0missing{\n "num_gpu": 99\n}missing
7608NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_015150__26610.04.432461[0, 528]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015150__266.json61.25missing{\n "num_gpu": 99\n}missing
7609NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_015153__27110.03.412581[0, 408]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015153__271.json61.25missing{\n "num_gpu": 99\n}missing
7610NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_015154__27100.00.9019670[0, 104]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_015154__271.json25.0missing{\n "num_gpu": 99\n}missing
7611NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_015122__43200.00.3765240[0, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015122__432.json0.0missing{\n "num_gpu": 99\n}missing
7612NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_015122__46650.02.881424[0, 343]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015122__466.json100.0missing{\n "num_gpu": 99\n}missing
7613NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_015123__17100.00.3746330[0, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015123__171.json0.0missing{\n "num_gpu": 99\n}missing
7614NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_015124__46500.01.296390[0, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015124__465.json0.0missing{\n "num_gpu": 99\n}missing
7615NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_015128__27100.03.898510[0, 461]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_015128__271.json25.0missing{\n "num_gpu": 99\n}missing
7616NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_015104__60900.02.368421[0, 273]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015104__609.json56.25missing{\n "num_gpu": 99\n}missing
7617NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_015108__17730.04.135784[0, 472]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015108__177.json90.0missing{\n "num_gpu": 99\n}missing
7618NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_015109__89100.00.8496290[0, 98]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015109__891.json0.0missing{\n "num_gpu": 99\n}missing
7619NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_015111__95440.02.457523[0, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015111__954.json88.75missing{\n "num_gpu": 99\n}missing
7620NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_015113__77300.01.429980[0, 165]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_015113__773.json0.0missing{\n "num_gpu": 99\n}missing
7621NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_015246__68300.04.255380[0, 477]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015246__683.json0.0missing{\n "num_gpu": 99\n}missing
7622NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015250__83600.03.886810[0, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015250__836.json25.0missing{\n "num_gpu": 99\n}missing
7623NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015252__18400.02.259120[0, 261]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015252__184.json25.0missing{\n "num_gpu": 99\n}missing
7624NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015256__29500.03.730440[0, 428]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015256__295.json25.0missing{\n "num_gpu": 99\n}missing
7625NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_015259__61300.02.838180[0, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_015259__613.json25.0missing{\n "num_gpu": 99\n}missing
7626NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_015213__69210.03.107931[0, 362]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015213__692.json61.25missing{\n "num_gpu": 99\n}missing
7627NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_015216__99050.02.63664[0, 307]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015216__990.json100.0missing{\n "num_gpu": 99\n}missing
7628NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_015219__41800.02.494730[0, 290]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015219__418.json25.0missing{\n "num_gpu": 99\n}missing
7629NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_015221__46800.02.197640[0, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015221__468.json25.0missing{\n "num_gpu": 99\n}missing
7630NVIDIA-RTX-4090-4xispersonalcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_015225__34910.04.226811[0, 469]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_015225__349.json61.25missing{\n "num_gpu": 99\n}missing
7631Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_154726__80500.064.93330[108, 388]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_154726__805.json0.0missing{\n "num_gpu": 99\n}missing
7632Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_154816__61800.050.06710[108, 297]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_154816__618.json0.0missing{\n "num_gpu": 99\n}missing
7633Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_154526__41400.049.60070[111, 294]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_154526__414.json50.0missing{\n "num_gpu": 99\n}missing
7634Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_154621__87300.054.32690[111, 323]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_154621__873.json50.0missing{\n "num_gpu": 99\n}missing
7635Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_010516__56300.059.37210[111, 354]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_010516__563.json50.0missing{\n "num_gpu": 99\n}missing
7636Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_154337__89500.049.60220[152, 288]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_154337__895.json25.0missing{\n "num_gpu": 99\n}missing
7637Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_154437__15000.059.58430[152, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_154437__150.json25.0missing{\n "num_gpu": 99\n}missing
7638Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_010416__13700.085.60990[152, 507]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_010416__137.json25.0missing{\n "num_gpu": 99\n}missing
7639Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_154156__82700.087.44020[226, 347]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_154156__827.json25.0missing{\n "num_gpu": 99\n}missing
7640Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_154247__14650.050.68234[226, 278]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_154247__146.json100.0missing{\n "num_gpu": 99\n}missing
7641Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_010251__21650.085.49354[226, 347]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_010251__216.json100.0missing{\n "num_gpu": 99\n}missing
7642Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_155155__60850.071.87224[440, 366]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155155__608.json100.0missing{\n "num_gpu": 99\n}missing
7643Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_155254__30600.059.37670[440, 296]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155254__306.json50.0missing{\n "num_gpu": 99\n}missing
7644Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_010749__32300.084.23590[440, 443]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_010749__323.json25.0missing{\n "num_gpu": 99\n}missing
7645Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_154931__39750.074.55784[438, 387]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_154931__397.json100.0missing{\n "num_gpu": 99\n}missing
7646Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_155042__12800.071.36810[438, 368]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155042__128.json50.0missing{\n "num_gpu": 99\n}missing
7647Apple-MacBook-Pro-M1ispersonaldeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_010625__65200.068.81740[438, 352]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_010625__652.json25.0missing{\n "num_gpu": 99\n}missing
7648Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_011444__13200.07.453320[106, 282]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_011444__132.json25.0missing{\n "num_gpu": 99\n}missing
7649Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_120723__83200.012.06750[106, 456]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_120723__832.json25.0missing{\n "num_gpu": 99\n}missing
7650Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_120730__30800.07.34660[106, 278]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_120730__308.json0.0missing{\n "num_gpu": 99\n}missing
7651Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_120742__11200.011.85590[106, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_120742__112.json0.0missing{\n "num_gpu": 99\n}missing
7652Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse520231227_011436__61400.06.04280[143, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_011436__614.json25.0missing{\n "num_gpu": 99\n}missing
7653Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_120658__30500.07.395940[143, 274]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_120658__305.json0.0missing{\n "num_gpu": 99\n}missing
7654Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_120703__72200.05.411520[143, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_120703__722.json0.0missing{\n "num_gpu": 99\n}missing
7655Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_120711__42900.07.721150[143, 286]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_120711__429.json0.0missing{\n "num_gpu": 99\n}missing
7656Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_011430__35800.012.54380[215, 330]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011430__358.json0.0missing{\n "num_gpu": 99\n}missing
7657Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_120635__93100.010.95370[215, 257]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120635__931.json0.0missing{\n "num_gpu": 99\n}missing
7658Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_120640__21300.04.920630[215, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120640__213.json0.0missing{\n "num_gpu": 99\n}missing
7659Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_120650__70200.010.41920[215, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120650__702.json0.0missing{\n "num_gpu": 99\n}missing
7660Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_011502__46200.06.785540[395, 205]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011502__462.json0.0missing{\n "num_gpu": 99\n}missing
7661Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_120823__83900.08.5330[395, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120823__839.json25.0missing{\n "num_gpu": 99\n}missing
7662Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_120830__54500.07.027280[395, 210]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120830__545.json0.0missing{\n "num_gpu": 99\n}missing
7663Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_120844__52000.014.78180[395, 486]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_120844__520.json0.0missing{\n "num_gpu": 99\n}missing
7664Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_011456__99300.011.58290[392, 378]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_011456__993.json0.0missing{\n "num_gpu": 99\n}missing
7665Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_120749__48200.06.167030[392, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_120749__482.json0.0missing{\n "num_gpu": 99\n}missing
7666Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_120801__52500.012.64170[392, 411]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_120801__525.json0.0missing{\n "num_gpu": 99\n}missing
7667Apple-MacBook-Pro-M1ispersonaldolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_120814__53200.012.85220[392, 419]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_120814__532.json0.0missing{\n "num_gpu": 99\n}missing
7668Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_110902__52300.05.532540[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110902__523.json0.0missingmissingmissing
7669Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_110904__38700.01.532840[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110904__387.json0.0missingmissingmissing
7670Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_110906__89700.02.055150[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110906__897.json25.0missingmissingmissing
7671Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_110910__83000.04.778890[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110910__830.json0.0missingmissingmissing
7672Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_110919__75700.08.598090[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_110919__757.json25.0missingmissingmissing
7673Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_110827__58000.02.485850[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110827__580.json0.0missingmissingmissing
7674Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_110829__56700.01.972350[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110829__567.json25.0missingmissingmissing
7675Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_110832__69500.02.809540[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110832__695.json25.0missingmissingmissing
7676Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_110835__27300.02.893460[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110835__273.json0.0missingmissingmissing
7677Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_110837__31900.02.177440[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_110837__319.json25.0missingmissingmissing
7678Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_110752__49100.03.49820[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110752__491.json25.0missingmissingmissing
7679Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_110757__21000.04.879050[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110757__210.json25.0missingmissingmissing
7680Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_110801__85600.04.13960[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110801__856.json0.0missingmissingmissing
7681Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_110807__14700.05.223310[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110807__147.json0.0missingmissingmissing
7682Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_110811__94700.04.879960[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_110811__947.json25.0missingmissingmissing
7683Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111025__97800.03.18130[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111025__978.json25.0missingmissingmissing
7684Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111040__22300.015.6090[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111040__223.json25.0missingmissingmissing
7685Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_111044__92300.03.298610[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111044__923.json0.0missingmissingmissing
7686Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111052__39600.08.320960[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111052__396.json25.0missingmissingmissing
7687Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111055__77000.03.137380[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111055__770.json25.0missingmissingmissing
7688Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_110949__48100.08.720870[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110949__481.json25.0missingmissingmissing
7689Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_110951__88800.02.644530[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110951__888.json0.0missingmissingmissing
7690Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_110955__37900.03.749150[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110955__379.json25.0missingmissingmissing
7691Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_110959__72900.03.786970[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_110959__729.json0.0missingmissingmissing
7692Apple-MacBook-Pro-M1ispersonalgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_111006__31000.06.838830[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111006__310.json25.0missingmissingmissing
7693Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_232606__90000.08.308110[0, 127]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_232606__900.json0.0missingmissingmissing
7694Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_232615__91400.08.328640[0, 126]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_232615__914.json0.0missingmissingmissing
7695Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_232628__46900.012.79980[0, 194]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_232628__469.json0.0missingmissingmissing
7696Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_232636__72300.08.171780[0, 128]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_232636__723.json0.0missingmissingmissing
7697Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_232655__73200.018.84710[0, 285]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_232655__732.json0.0missingmissingmissing
7698Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_232422__92900.011.06620[0, 173]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_232422__929.json25.0missingmissingmissing
7699Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_232430__17700.07.778440[0, 116]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_232430__177.json0.0missingmissingmissing
7700Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_232442__99000.012.74170[0, 196]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_232442__990.json25.0missingmissingmissing
7701Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_232450__73600.07.62630[0, 116]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_232450__736.json0.0missingmissingmissing
7702Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_232500__55800.010.01560[0, 154]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_232500__558.json25.0missingmissingmissing
7703Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_232238__16200.017.59560[0, 268]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_232238__162.json0.0missingmissingmissing
7704Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_232254__47700.016.8790[0, 258]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_232254__477.json0.0missingmissingmissing
7705Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_232310__12700.015.5760[0, 235]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_232310__127.json0.0missingmissingmissing
7706Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_232324__35400.013.89010[0, 211]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_232324__354.json25.0missingmissingmissing
7707Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_232335__14600.011.14180[0, 170]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_232335__146.json25.0missingmissingmissing
7708Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240223_233241__42300.020.62650[0, 308]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_233241__423.json0.0missingmissingmissing
7709Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240223_233316__70400.034.80430[0, 523]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_233316__704.json0.0missingmissingmissing
7710Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse520240223_233331__49300.015.08640[0, 231]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_233331__493.json25.0missingmissingmissing
7711Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240223_233349__86000.018.80710[0, 284]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_233349__860.json0.0missingmissingmissing
7712Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse520240223_233412__81900.022.32920[0, 338]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_233412__819.json25.0missingmissingmissing
7713Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_232847__80800.020.38140[0, 310]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_232847__808.json0.0missingmissingmissing
7714Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse520240223_232902__49000.014.8890[0, 226]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_232902__490.json25.0missingmissingmissing
7715Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_232927__30400.024.45910[0, 373]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_232927__304.json0.0missingmissingmissing
7716Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse520240223_232942__24000.015.15340[0, 229]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_232942__240.json25.0missingmissingmissing
7717Apple-MacBook-Pro-M1ispersonalgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_233001__90200.019.47990[0, 294]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_233001__902.json0.0missingmissingmissing
7718Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboAsIs1SHOTfalsefalse520231213_202619__98300.00046957.039190[96, 281]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_202619__983.json0.0missingmissingmissing
7719Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboAsIs1SHOTfalsefalse520231225_193401__34500.0004564.092740[96, 272]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_193401__345.json0.0missingmissingmissing
7720Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboAsIs1SHOTfalsefalse520231225_193405__41400.00046654.656220[96, 279]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_193405__414.json0.0missingmissingmissing
7721Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_194937__87900.05.074680[96, 248]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_194937__879.json0.00.5missing0.5
7722Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboInJulia1SHOTtruetrue520231213_202611__82400.00042756.473930[99, 252]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_202611__824.json50.0missingmissingmissing
7723Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboInJulia1SHOTtruetrue520231225_193353__90950.00040053.643124[99, 234]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_193353__909.json100.0missingmissingmissing
7724Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboInJulia1SHOTtruetrue520231225_193357__41700.0003993.571980[99, 233]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_193357__417.json50.0missingmissingmissing
7725Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboInJulia1SHOTtruetrue520231227_200842__44850.00042154.087484[99, 248]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_200842__448.json100.0missingmissingmissing
7726Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboInJulia1SHOTtruetrue520231227_200848__52950.00054455.509754[99, 330]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_200848__529.json100.0missingmissingmissing
7727Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_194932__98300.04.894690[99, 238]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_194932__983.json50.00.5missing0.5
7728Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_202605__22000.0003374.025160[134, 180]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_202605__220.json50.0missingmissingmissing
7729Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertAsk1SHOTtruefalse520231225_193346__56400.0002952.163880[134, 152]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_193346__564.json25.0missingmissingmissing
7730Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertAsk1SHOTtruefalse520231225_193349__47100.0003582.827830[134, 194]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_193349__471.json25.0missingmissingmissing
7731Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_200836__33000.00039553.537450[134, 219]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_200836__330.json50.0missingmissingmissing
7732Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertAsk1SHOTtruefalse520231227_200838__33100.0001721.350190[134, 70]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_200838__331.json25.0missingmissingmissing
7733Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_194927__30600.04.670340[134, 223]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_194927__306.json50.00.5missing0.5
7734Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertCoTTask1SHOTtruefalse520231213_202601__99700.0004555.701080[196, 238]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202601__997.json25.0missingmissingmissing
7735Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_193340__33250.0003742.943834[196, 184]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193340__332.json100.0missingmissingmissing
7736Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_193344__75800.00045053.671330[196, 235]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193344__758.json50.0missingmissingmissing
7737Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertCoTTask1SHOTtruefalse520231227_200829__22500.0001610.9531210[196, 42]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200829__225.json25.0missingmissingmissing
7738Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_200833__86850.00043554.223934[196, 225]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200833__868.json100.0missingmissingmissing
7739Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTtruetrue520231215_194922__22850.04.639974[196, 213]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194922__228.json100.00.5missing0.5
7740Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231213_202630__61900.0005796.291710[357, 267]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202630__619.json50.0missingmissingmissing
7741Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_193418__78000.00038252.382220[357, 136]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193418__780.json0.0missingmissingmissing
7742Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_193423__27600.0005074.404490[357, 219]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193423__276.json0.0missingmissingmissing
7743Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapCoTTask1SHOTtruefalse520231227_200859__81100.00055654.276280[357, 252]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200859__811.json25.0missingmissingmissing
7744Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapCoTTask1SHOTtruefalse520231227_200903__29000.00050554.103130[357, 218]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200903__290.json25.0missingmissingmissing
7745Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue520231215_194947__40450.05.201864[357, 250]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_194947__404.json100.00.5missing0.5
7746Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapTask1SHOTtruefalse520231213_202623__80300.00048554.56490[356, 205]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_202623__803.json25.0missingmissingmissing
7747Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapTask1SHOTtruefalse520231225_193410__89100.0005984.230440[356, 280]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_193410__891.json25.0missingmissingmissing
7748Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapTask1SHOTtruefalse520231225_193416__30100.0007366.000780[356, 372]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_193416__301.json25.0missingmissingmissing
7749Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_200849__96300.0002531.211820[356, 50]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_200849__963.json0.0missingmissingmissing
7750Apple-MacBook-Pro-M1ispersonalgpt-3.5-turboJuliaRecapTask1SHOTtruefalse520231227_200854__40900.00059655.507780[356, 279]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_200854__409.json25.0missingmissingmissing
7751Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo--optimJuliaRecapTask1SHOTtruetrue520231215_194942__62600.05.198574[356, 246]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_194942__626.json75.00.5missing0.5
7752Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200507__59850.00037351.787234[99, 216]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200507__598.json100.0missingmissingmissing
7753Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200509__47100.0004081.775460[99, 239]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200509__471.json50.0missingmissingmissing
7754Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200511__58650.00035251.711614[99, 202]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200511__586.json100.0missingmissingmissing
7755Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200512__33750.0002971.362814[99, 165]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200512__337.json100.0missingmissingmissing
7756Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200514__43700.0003481.747530[99, 199]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200514__437.json50.0missingmissingmissing
7757Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200502__19530.000190.9753664[134, 82]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200502__195.json90.0missingmissingmissing
7758Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200503__88550.00017950.7630344[134, 75]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200503__885.json100.0missingmissingmissing
7759Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200504__81650.0001960.8592414[134, 86]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200504__816.json100.0missingmissingmissing
7760Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200505__46650.0002171.069784[134, 100]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200505__466.json100.0missingmissingmissing
7761Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruefalse520240201_200506__71500.00019150.7514510[134, 83]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200506__715.json25.0missingmissingmissing
7762Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200457__18350.00024951.10194[196, 101]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200457__183.json100.0missingmissingmissing
7763Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200458__54050.0002510.9015094[196, 102]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200458__540.json100.0missingmissingmissing
7764Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200459__27850.00025551.107754[196, 105]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200459__278.json100.0missingmissingmissing
7765Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200500__64150.00024651.065064[196, 99]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200500__641.json100.0missingmissingmissing
7766Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200501__36450.00020750.8935674[196, 73]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200501__364.json100.0missingmissingmissing
7767Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200523__11350.00048451.735084[357, 204]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200523__113.json100.0missingmissingmissing
7768Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200524__99100.00028050.6691180[357, 68]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200524__991.json0.0missingmissingmissing
7769Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200526__30700.0002820.6726670[357, 69]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200526__307.json0.0missingmissingmissing
7770Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200526__88350.00049651.750544[357, 212]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200526__883.json100.0missingmissingmissing
7771Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200527__95000.00030751.028960[357, 86]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200527__950.json0.0missingmissingmissing
7772Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200515__44550.00033851.025514[356, 107]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200515__445.json100.0missingmissingmissing
7773Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200517__49950.000431.367344[356, 168]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200517__499.json100.0missingmissingmissing
7774Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruefalse520240201_200518__52000.0003941.368970[356, 144]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200518__520.json25.0missingmissingmissing
7775Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200519__26110.0004181.440351[356, 160]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200519__261.json61.25missingmissingmissing
7776Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200521__75700.0004631.677870[356, 190]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200521__757.json50.0missingmissingmissing
7777Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_202644__62100.000564.398980[96, 232]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_202644__621.json0.0missingmissingmissing
7778Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_193438__77000.0005363.073610[96, 220]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_193438__770.json0.0missingmissingmissing
7779Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_193441__34400.0005622.874920[96, 233]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_193441__344.json0.0missingmissingmissing
7780Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_195002__25900.05.892750[96, 231]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_195002__259.json0.00.9missing0.1
7781Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_202639__64650.0005754.922324[99, 238]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_202639__646.json100.0missingmissingmissing
7782Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_193432__16650.0005093.125134[99, 205]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_193432__166.json100.0missingmissingmissing
7783Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_193435__57900.0004292.20180[99, 165]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_193435__579.json50.0missingmissingmissing
7784Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_200913__38330.0005232.812774[99, 212]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_200913__383.json90.0missingmissingmissing
7785Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_200916__50450.0005313.034344[99, 216]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_200916__504.json100.0missingmissingmissing
7786Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_194955__64600.04.145890[99, 202]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_194955__646.json50.00.9missing0.1
7787Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_202634__47150.000311.688354[134, 88]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_202634__471.json100.0missingmissingmissing
7788Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_193427__46400.0002861.377990[134, 76]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_193427__464.json50.0missingmissingmissing
7789Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruefalse520231225_193429__85000.000311.69550[134, 88]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_193429__850.json25.0missingmissingmissing
7790Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruefalse520231227_200908__59500.0002881.402290[134, 77]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_200908__595.json25.0missingmissingmissing
7791Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_200910__26550.0003481.761944[134, 107]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_200910__265.json100.0missingmissingmissing
7792Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_194951__70250.01.566884[134, 88]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_194951__702.json100.00.9missing0.1
7793Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_202632__28450.0003782.746924[196, 91]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202632__284.json100.0missingmissingmissing
7794Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_193424__61250.0003721.42794[196, 88]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193424__612.json100.0missingmissingmissing
7795Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_193426__63350.000371.679864[196, 87]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193426__633.json100.0missingmissingmissing
7796Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_200904__69050.000321.510364[196, 62]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200904__690.json100.0missingmissingmissing
7797Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_200907__23350.0004242.182954[196, 114]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200907__233.json100.0missingmissingmissing
7798Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_194950__93850.01.951874[196, 91]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_194950__938.json100.00.9missing0.1
7799Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231213_202651__34600.0005171.684190[357, 80]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202651__346.json0.0missingmissingmissing
7800Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruefalse520231225_193446__20000.0004871.123390[357, 65]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193446__200.json25.0missingmissingmissing
7801Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231225_193449__65100.0007632.799210[357, 203]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193449__651.json50.0missingmissingmissing
7802Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_200924__43200.0005912.136580[357, 117]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200924__432.json0.0missingmissingmissing
7803Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231227_200929__35450.0008474.485914[357, 245]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_200929__354.json100.0missingmissingmissing
7804Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTtruefalse520231215_195008__79800.04.225390[357, 171]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195008__798.json25.00.9missing0.1
7805Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_202649__49450.0009245.458834[356, 284]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_202649__494.json100.0missingmissingmissing
7806Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_193444__72650.000712.90534[356, 177]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_193444__726.json100.0missingmissingmissing
7807Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_193445__81400.000450.879610[356, 47]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_193445__814.json0.0missingmissingmissing
7808Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_200918__54900.0005261.894790[356, 85]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_200918__549.json0.0missingmissingmissing
7809Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_200922__80150.0008664.02124[356, 255]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_200922__801.json100.0missingmissingmissing
7810Apple-MacBook-Pro-M1ispersonalgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_195003__12450.01.696144[356, 62]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_195003__124.json100.00.9missing0.1
7811Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewInJulia1SHOTtruetrue520240201_095139__32750.0139833.09894[99, 433]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_095139__327.json100.0missingmissingmissing
7812Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewInJulia1SHOTtruetrue520240201_095213__37300.0120333.85360[99, 368]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_095213__373.json50.0missingmissingmissing
7813Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewInJulia1SHOTtruetrue520240201_095237__53000.0136523.93210[99, 422]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_095237__530.json50.0missingmissingmissing
7814Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewInJulia1SHOTtruetrue520240201_095316__84050.017139.07254[99, 537]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_095316__840.json100.0missingmissingmissing
7815Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewInJulia1SHOTtruefalse520240201_095402__62600.0138345.21610[99, 428]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_095402__626.json25.0missingmissingmissing
7816Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_094633__67400.0069827.24940[134, 188]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_094633__674.json50.0missingmissingmissing
7817Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_094644__79900.0070411.14070[134, 190]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_094644__799.json50.0missingmissingmissing
7818Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_094657__63100.006512.80720[134, 172]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_094657__631.json50.0missingmissingmissing
7819Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_094729__51900.0104331.96320[134, 303]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_094729__519.json50.0missingmissingmissing
7820Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertAsk1SHOTtruefalse520240201_094802__16200.0116933.06730[134, 345]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_094802__162.json25.0missingmissingmissing
7821Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_094222__16600.0115924.09990[196, 321]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_094222__166.json25.0missingmissingmissing
7822Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_094251__47750.0138729.0814[196, 397]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_094251__477.json100.0missingmissingmissing
7823Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_094317__96150.0121625.96994[196, 340]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_094317__961.json100.0missingmissingmissing
7824Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_094347__51600.0121929.29360[196, 341]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_094347__516.json25.0missingmissingmissing
7825Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_094409__24750.0133322.2614[196, 379]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_094409__247.json100.0missingmissingmissing
7826Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_100636__13500.018641.4440[357, 501]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_100636__135.json50.0missingmissingmissing
7827Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_100722__76350.0184846.27354[357, 497]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_100722__763.json100.0missingmissingmissing
7828Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruefalse520240201_100824__29900.0172261.25190[357, 455]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_100824__299.json25.0missingmissingmissing
7829Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_100855__46800.0120331.65330[357, 282]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_100855__468.json50.0missingmissingmissing
7830Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_100953__74000.0202257.78330[357, 555]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_100953__740.json50.0missingmissingmissing
7831Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_095922__56030.0138239.97634[356, 342]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_095922__560.json90.0missingmissingmissing
7832Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_095959__26750.0177537.15234[356, 473]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_095959__267.json100.0missingmissingmissing
7833Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapTask1SHOTtruefalse520240201_100035__47300.0158636.34740[356, 410]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_100035__473.json25.0missingmissingmissing
7834Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapTask1SHOTtruefalse520240201_100112__21800.0172436.66680[356, 456]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_100112__218.json25.0missingmissingmissing
7835Apple-MacBook-Pro-M1ispersonalgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_100158__97300.0198246.45120[356, 542]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_100158__973.json50.0missingmissingmissing
7836Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewAsIs1SHOTfalsefalse520231213_202832__67300.0101119.81670[96, 305]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_202832__673.json0.0missingmissingmissing
7837Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_193711__72300.0114621.31640[96, 350]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_193711__723.json0.0missingmissingmissing
7838Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_193728__20100.0107416.97590[96, 326]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_193728__201.json0.0missingmissingmissing
7839Apple-MacBook-Pro-M1ispersonalgpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_195143__29500.021.86150[96, 329]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_195143__295.json0.00.1missing0.9
7840Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewInJulia1SHOTtruetrue520231213_202812__33600.0174645.44390[99, 549]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_202812__336.json50.0missingmissingmissing
7841Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewInJulia1SHOTtruetrue520231225_193630__54100.0133520.79020[99, 412]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_193630__541.json50.0missingmissingmissing
7842Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewInJulia1SHOTtruetrue520231225_193650__21950.0155119.8224[99, 484]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_193650__219.json100.0missingmissingmissing
7843Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewInJulia1SHOTtruetrue520231227_201058__55000.0101426.90220[99, 305]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_201058__550.json50.0missingmissingmissing
7844Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewInJulia1SHOTtruetrue520231227_201118__50900.0105619.42290[99, 319]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_201118__509.json50.0missingmissingmissing
7845Apple-MacBook-Pro-M1ispersonalgpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_195121__23550.041.05054[99, 504]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_195121__235.json100.00.1missing0.9
7846Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_202726__37700.0086917.4310[134, 245]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_202726__377.json50.0missingmissingmissing
7847Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_193558__70350.0113612.20674[134, 334]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_193558__703.json100.0missingmissingmissing
7848Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_193609__52300.0098610.92260[134, 284]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_193609__523.json50.0missingmissingmissing
7849Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_201019__60200.0083316.730[134, 233]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_201019__602.json50.0missingmissingmissing
7850Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_201031__32300.0059312.02490[134, 153]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_201031__323.json50.0missingmissingmissing
7851Apple-MacBook-Pro-M1ispersonalgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_195040__95800.025.25120[134, 245]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_195040__958.json50.00.1missing0.9
7852Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_202709__81150.0087417.48474[196, 226]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202709__811.json100.0missingmissingmissing
7853Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231225_193532__30800.0129742.79060[196, 367]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193532__308.json25.0missingmissingmissing
7854Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_193546__98250.0088313.72344[196, 229]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193546__982.json100.0missingmissingmissing
7855Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_200948__15950.0119219.63084[196, 332]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_200948__159.json100.0missingmissingmissing
7856Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_201002__15350.008513.90724[196, 218]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201002__153.json100.0missingmissingmissing
7857Apple-MacBook-Pro-M1ispersonalgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195015__82650.06.796594[196, 100]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195015__826.json100.00.1missing0.9
7858Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_202941__25400.019241.68960[357, 521]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_202941__254.json50.0missingmissingmissing
7859Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruefalse520231225_193814__31700.0172222.00450[357, 455]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193814__317.json25.0missingmissingmissing
7860Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_193829__81500.0143115.20440[357, 358]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193829__815.json50.0missingmissingmissing
7861Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapCoTTask1SHOTfalsefalse520231227_201241__56300.0210943.26820[357, 584]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201241__563.json0.0missingmissingmissing
7862Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_201320__67200.0157538.80220[357, 406]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201320__672.json50.0missingmissingmissing
7863Apple-MacBook-Pro-M1ispersonalgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_195234__14300.029.48750[357, 389]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195234__143.json50.00.1missing0.9
7864Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_202859__49100.0154727.48150[356, 397]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_202859__491.json50.0missingmissingmissing
7865Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapTask1SHOTtruefalse520231225_193743__43900.0187114.93420[356, 505]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_193743__439.json25.0missingmissingmissing
7866Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_193752__63200.01228.670390[356, 288]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_193752__632.json50.0missingmissingmissing
7867Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_201137__92500.014318.85160[356, 358]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_201137__925.json50.0missingmissingmissing
7868Apple-MacBook-Pro-M1ispersonalgpt-4-1106-previewJuliaRecapTask1SHOTtruefalse520231227_201158__13500.0138821.23670[356, 344]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_201158__135.json25.0missingmissingmissing
7869Apple-MacBook-Pro-M1ispersonalgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_195205__90750.021.84694[356, 297]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_195205__907.json100.00.1missing0.9
7870Apple-MacBook-Pro-M1ispersonalllama2AsIs1SHOTfalsefalse520231214_073331__38100.018.84230[96, 543]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__AsIs__1SHOT__20231214_073331__381.json0.0missingmissingmissing
7871Apple-MacBook-Pro-M1ispersonalllama2AsIs1SHOTfalsefalse520231225_150616__26500.09.826130[96, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__AsIs__1SHOT__20231225_150616__265.json0.0missing{\n "num_gpu": 99\n}missing
7872Apple-MacBook-Pro-M1ispersonalllama2AsIs1SHOTfalsefalse520231225_150627__69300.011.42890[1, 354]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__AsIs__1SHOT__20231225_150627__693.json0.0missing{\n "num_gpu": 99\n}missing
7873Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTtruefalse520231214_073313__11400.011.47330[113, 330]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231214_073313__114.json25.0missingmissingmissing
7874Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTfalsefalse520231225_150549__32000.016.42830[113, 473]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231225_150549__320.json0.0missing{\n "num_gpu": 99\n}missing
7875Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTtruefalse520231225_150606__88400.016.49420[1, 498]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231225_150606__884.json25.0missing{\n "num_gpu": 99\n}missing
7876Apple-MacBook-Pro-M1ispersonalllama2InJulia1SHOTfalsefalse520231227_004408__61000.014.190[113, 415]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__InJulia__1SHOT__20231227_004408__610.json0.0missing{\n "num_gpu": 99\n}missing
7877Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTtruefalse520231214_073301__29100.010.36250[142, 286]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_073301__291.json25.0missingmissingmissing
7878Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTtruefalse520231225_150519__54100.013.02450[142, 365]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_150519__541.json25.0missing{\n "num_gpu": 99\n}missing
7879Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTtruefalse520231225_150533__43300.014.03560[1, 423]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_150533__433.json25.0missing{\n "num_gpu": 99\n}missing
7880Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertAsk1SHOTfalsefalse520231227_004354__84200.09.574410[142, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_004354__842.json0.0missing{\n "num_gpu": 99\n}missing
7881Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTtruefalse520231214_073251__83200.017.31020[217, 455]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073251__832.json25.0missingmissingmissing
7882Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_150457__53700.012.43880[235, 177]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150457__537.json0.0missing{\n "num_gpu": 99\n}missing
7883Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTtruefalse520231225_150506__39300.08.81890[1, 266]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150506__393.json25.0missing{\n "num_gpu": 99\n}missing
7884Apple-MacBook-Pro-M1ispersonalllama2JuliaExpertCoTTask1SHOTfalsefalse520231227_004344__59700.013.30880[235, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004344__597.json0.0missing{\n "num_gpu": 99\n}missing
7885Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTfalsefalse520231214_073431__60700.026.78390[11, 699]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073431__607.json0.0missingmissingmissing
7886Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTtruefalse520231225_150743__32000.025.9220[11, 684]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150743__320.json25.0missing{\n "num_gpu": 99\n}missing
7887Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTtruefalse520231225_150803__46200.019.90870[1, 541]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150803__462.json25.0missing{\n "num_gpu": 99\n}missing
7888Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapCoTTask1SHOTtruefalse520231227_004500__23100.019.14550[11, 521]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004500__231.json25.0missing{\n "num_gpu": 99\n}missing
7889Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTtruefalse520231214_073404__40600.032.9710[413, 761]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_073404__406.json25.0missingmissingmissing
7890Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTtruefalse520231225_150654__70300.026.33140[413, 605]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_150654__703.json25.0missing{\n "num_gpu": 99\n}missing
7891Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTfalsefalse520231225_150717__52300.023.16210[1, 622]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_150717__523.json0.0missing{\n "num_gpu": 99\n}missing
7892Apple-MacBook-Pro-M1ispersonalllama2JuliaRecapTask1SHOTtruefalse520231227_004440__21900.032.54110[413, 761]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_004440__219.json25.0missing{\n "num_gpu": 99\n}missing
7893Apple-MacBook-Pro-M1ispersonalmagicoderAsIs1SHOTfalsefalse520231214_074436__67200.019.98520[96, 574]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__AsIs__1SHOT__20231214_074436__672.json0.0missingmissingmissing
7894Apple-MacBook-Pro-M1ispersonalmagicoderAsIs1SHOTfalsefalse520231225_152655__75700.010.03190[110, 324]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__AsIs__1SHOT__20231225_152655__757.json0.0missing{\n "num_gpu": 99\n}missing
7895Apple-MacBook-Pro-M1ispersonalmagicoderAsIs1SHOTfalsefalse520231225_152710__18400.015.10460[110, 491]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__AsIs__1SHOT__20231225_152710__184.json0.0missing{\n "num_gpu": 99\n}missing
7896Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruefalse520231214_074416__31700.012.37130[113, 356]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231214_074416__317.json25.0missingmissingmissing
7897Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruetrue520231225_152636__42440.010.32173[113, 334]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231225_152636__424.json88.75missing{\n "num_gpu": 99\n}missing
7898Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruetrue520231225_152645__27100.08.48650[113, 271]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231225_152645__271.json50.0missing{\n "num_gpu": 99\n}missing
7899Apple-MacBook-Pro-M1ispersonalmagicoderInJulia1SHOTtruetrue520231227_005359__99000.010.67980[113, 343]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__InJulia__1SHOT__20231227_005359__990.json50.0missing{\n "num_gpu": 99\n}missing
7900Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruefalse520231214_074404__87500.09.817420[142, 270]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_074404__875.json25.0missingmissingmissing
7901Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruetrue520231225_152615__88050.07.885564[152, 246]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_152615__880.json100.0missing{\n "num_gpu": 99\n}missing
7902Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruetrue520231225_152626__76340.010.16043[152, 321]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_152626__763.json88.75missing{\n "num_gpu": 99\n}missing
7903Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertAsk1SHOTtruetrue520231227_005348__53250.07.710034[152, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_005348__532.json100.0missing{\n "num_gpu": 99\n}missing
7904Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruefalse520231214_074354__51400.015.78950[217, 414]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074354__514.json25.0missingmissingmissing
7905Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_152600__94650.013.09234[227, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152600__946.json100.0missing{\n "num_gpu": 99\n}missing
7906Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_152607__71250.06.909334[227, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152607__712.json100.0missing{\n "num_gpu": 99\n}missing
7907Apple-MacBook-Pro-M1ispersonalmagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_005340__84250.018.94344[227, 400]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005340__842.json100.0missing{\n "num_gpu": 99\n}missing
7908Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTfalsefalse520231214_074540__51700.031.87170[11, 820]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074540__517.json0.0missingmissingmissing
7909Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTtruefalse520231225_152743__74300.010.7230[416, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152743__743.json25.0missing{\n "num_gpu": 99\n}missing
7910Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTtruefalse520231225_152755__61200.012.01310[416, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152755__612.json25.0missing{\n "num_gpu": 99\n}missing
7911Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_005420__90200.010.42650[416, 280]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005420__902.json50.0missing{\n "num_gpu": 99\n}missing
7912Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTfalsefalse520231214_074508__93300.031.49760[413, 726]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_074508__933.json0.0missingmissingmissing
7913Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTtruefalse520231225_152723__50200.013.24380[413, 371]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_152723__502.json25.0missing{\n "num_gpu": 99\n}missing
7914Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTtruefalse520231225_152732__73400.09.021770[413, 238]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_152732__734.json25.0missing{\n "num_gpu": 99\n}missing
7915Apple-MacBook-Pro-M1ispersonalmagicoderJuliaRecapTask1SHOTtruetrue520231227_005410__24030.010.48784[413, 282]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_005410__240.json90.0missing{\n "num_gpu": 99\n}missing
7916Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KInJulia1SHOTfalsefalse520231227_181408__46500.015.56650[113, 297]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181408__465.json0.0missing{\n "num_gpu": 99\n}missing
7917Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KInJulia1SHOTfalsefalse520231227_181421__82400.013.33970[113, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181421__824.json0.0missing{\n "num_gpu": 99\n}missing
7918Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181439__65950.018.17064[113, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181439__659.json100.0missing{\n "num_gpu": 99\n}missing
7919Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181312__13940.017.57053[152, 332]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181312__139.json88.75missing{\n "num_gpu": 99\n}missing
7920Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181330__80040.018.48873[152, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181330__800.json88.75missing{\n "num_gpu": 99\n}missing
7921Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_181352__78400.022.15910[152, 421]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181352__784.json0.0missing{\n "num_gpu": 99\n}missing
7922Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_181226__45100.018.55240[227, 339]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181226__451.json0.0missing{\n "num_gpu": 99\n}missing
7923Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181243__62100.017.09470[227, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181243__621.json25.0missing{\n "num_gpu": 99\n}missing
7924Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181254__10610.011.25221[227, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181254__106.json61.25missing{\n "num_gpu": 99\n}missing
7925Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_181544__59900.015.30870[416, 255]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181544__599.json25.0missing{\n "num_gpu": 99\n}missing
7926Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_181608__72700.023.26540[416, 398]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181608__727.json0.0missing{\n "num_gpu": 99\n}missing
7927Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181629__52500.021.00570[416, 341]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181629__525.json50.0missing{\n "num_gpu": 99\n}missing
7928Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181457__24650.017.74224[413, 301]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181457__246.json100.0missing{\n "num_gpu": 99\n}missing
7929Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_181514__42700.016.14170[413, 270]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181514__427.json25.0missing{\n "num_gpu": 99\n}missing
7930Apple-MacBook-Pro-M1ispersonalmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181529__46950.014.74654[413, 244]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181529__469.json100.0missing{\n "num_gpu": 99\n}missing
7931Apple-MacBook-Pro-M1ispersonalmistral-mediumAsIs1SHOTfalsefalse520231213_203142__59400.0072004619.17550[108, 854]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__AsIs__1SHOT__20231213_203142__594.json0.0missingmissingmissing
7932Apple-MacBook-Pro-M1ispersonalmistral-mediumAsIs1SHOTfalsefalse520231225_194213__80200.0038997415.17070[108, 446]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__AsIs__1SHOT__20231225_194213__802.json0.0missingmissingmissing
7933Apple-MacBook-Pro-M1ispersonalmistral-mediumAsIs1SHOTfalsefalse520231225_194229__49200.004579315.97610[108, 530]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__AsIs__1SHOT__20231225_194229__492.json0.0missingmissingmissing
7934Apple-MacBook-Pro-M1ispersonalmistral-medium--optimAsIs1SHOTfalsefalse520231215_195445__40600.026.11470[108, 431]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__AsIs__1SHOT__20231215_195445__406.json0.00.9missing0.3
7935Apple-MacBook-Pro-M1ispersonalmistral-mediumInJulia1SHOTtruefalse520231213_203123__64300.0040453710.33840[111, 463]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__InJulia__1SHOT__20231213_203123__643.json25.0missingmissingmissing
7936Apple-MacBook-Pro-M1ispersonalmistral-mediumInJulia1SHOTtruefalse520231225_194146__65500.0025487214.81840[111, 278]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__InJulia__1SHOT__20231225_194146__655.json25.0missingmissingmissing
7937Apple-MacBook-Pro-M1ispersonalmistral-mediumInJulia1SHOTtruefalse520231225_194158__59400.0044984111.6020[111, 519]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__InJulia__1SHOT__20231225_194158__594.json25.0missingmissingmissing
7938Apple-MacBook-Pro-M1ispersonalmistral-mediumInJulia1SHOTtruetrue520231227_201621__56200.0043608829.7250[111, 502]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__InJulia__1SHOT__20231227_201621__562.json50.0missingmissingmissing
7939Apple-MacBook-Pro-M1ispersonalmistral-mediumInJulia1SHOTtruefalse520231227_201644__44100.0035033422.57770[111, 396]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__InJulia__1SHOT__20231227_201644__441.json25.0missingmissingmissing
7940Apple-MacBook-Pro-M1ispersonalmistral-medium--optimInJulia1SHOTtruefalse520231215_195419__27900.030.30620[111, 468]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__InJulia__1SHOT__20231215_195419__279.json25.00.9missing0.3
7941Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertAsk1SHOTtruefalse520231213_203112__88700.004207313.95580[150, 470]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_203112__887.json25.0missingmissingmissing
7942Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_194121__24500.003729999.294980[150, 411]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_194121__245.json25.0missingmissingmissing
7943Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_194131__80500.003956519.879690[150, 439]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_194131__805.json50.0missingmissingmissing
7944Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_201529__92900.0031798713.52930[150, 343]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_201529__929.json50.0missingmissingmissing
7945Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_201551__24200.0040859521.81970[150, 455]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_201551__242.json25.0missingmissingmissing
7946Apple-MacBook-Pro-M1ispersonalmistral-medium--optimJuliaExpertAsk1SHOTtruefalse520231215_195349__19200.013.62050[150, 613]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_195349__192.json25.00.9missing0.3
7947Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_203058__71150.0046686811.34944[225, 502]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203058__711.json100.0missingmissingmissing
7948Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231225_194057__71100.0037221528.92120[225, 385]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194057__711.json25.0missingmissingmissing
7949Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_194111__80150.0039324913.97744[225, 411]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194111__801.json100.0missingmissingmissing
7950Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_201506__44500.00279186.160770[225, 270]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201506__445.json25.0missingmissingmissing
7951Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_201516__21350.003932499.233114[225, 411]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201516__213.json100.0missingmissingmissing
7952Apple-MacBook-Pro-M1ispersonalmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195335__99950.010.23724[225, 461]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195335__999.json100.00.9missing0.3
7953Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231213_203229__12700.0055160638.18350[413, 544]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203229__127.json25.0missingmissingmissing
7954Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_194312__22000.0063007914.7210[413, 641]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194312__220.json25.0missingmissingmissing
7955Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_194324__12600.0050711111.22880[413, 489]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194324__126.json25.0missingmissingmissing
7956Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231227_201734__19900.0057344927.46630[413, 571]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201734__199.json25.0missingmissingmissing
7957Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231227_201759__86800.008962424.76190[413, 970]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201759__868.json0.0missingmissingmissing
7958Apple-MacBook-Pro-M1ispersonalmistral-medium--optimJuliaRecapCoTTask1SHOTtruefalse520231215_195534__47500.018.56760[413, 476]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195534__475.json25.00.9missing0.3
7959Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapTask1SHOTtruefalse520231213_203150__94500.004173118.654450[410, 379]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_203150__945.json25.0missingmissingmissing
7960Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapTask1SHOTtruefalse520231225_194245__19000.0067942716.14210[410, 703]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_194245__190.json25.0missingmissingmissing
7961Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapTask1SHOTtruefalse520231225_194258__21600.0055403212.67240[410, 548]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_194258__216.json25.0missingmissingmissing
7962Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapTask1SHOTfalsefalse520231227_201649__25300.0019165.704690[410, 100]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_201649__253.json0.0missingmissingmissing
7963Apple-MacBook-Pro-M1ispersonalmistral-mediumJuliaRecapTask1SHOTtruefalse520231227_201707__55900.0036715317.24120[410, 317]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_201707__559.json25.0missingmissingmissing
7964Apple-MacBook-Pro-M1ispersonalmistral-medium--optimJuliaRecapTask1SHOTtruefalse520231215_195515__57000.029.87650[410, 429]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_195515__570.json25.00.9missing0.3
7965Apple-MacBook-Pro-M1ispersonalmistral-smallAsIs1SHOTtruetrue520231213_203034__31750.0006324743.968244[102, 292]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__AsIs__1SHOT__20231213_203034__317.json100.0missingmissingmissing
7966Apple-MacBook-Pro-M1ispersonalmistral-smallAsIs1SHOTfalsefalse520231225_193946__35500.0006848544.40720[102, 319]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__AsIs__1SHOT__20231225_193946__355.json0.0missingmissingmissing
7967Apple-MacBook-Pro-M1ispersonalmistral-smallAsIs1SHOTfalsefalse520231225_193952__23700.0009816746.944820[102, 472]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__AsIs__1SHOT__20231225_193952__237.json0.0missingmissingmissing
7968Apple-MacBook-Pro-M1ispersonalmistral-small--optimAsIs1SHOTfalsefalse520231215_195312__50800.05.744420[102, 426]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__AsIs__1SHOT__20231215_195312__508.json0.00.9missing0.3
7969Apple-MacBook-Pro-M1ispersonalmistral-smallInJulia1SHOTtruetrue520231213_203030__47200.0006188953.857390[105, 284]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__InJulia__1SHOT__20231213_203030__472.json50.0missingmissingmissing
7970Apple-MacBook-Pro-M1ispersonalmistral-smallInJulia1SHOTtruetrue520231225_193936__36300.0007643954.980790[105, 359]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__InJulia__1SHOT__20231225_193936__363.json50.0missingmissingmissing
7971Apple-MacBook-Pro-M1ispersonalmistral-smallInJulia1SHOTtruetrue520231225_193941__88100.0007546954.809080[105, 354]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__InJulia__1SHOT__20231225_193941__881.json50.0missingmissingmissing
7972Apple-MacBook-Pro-M1ispersonalmistral-smallInJulia1SHOTtruetrue520231227_201421__36100.0006305354.025380[105, 290]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__InJulia__1SHOT__20231227_201421__361.json50.0missingmissingmissing
7973Apple-MacBook-Pro-M1ispersonalmistral-smallInJulia1SHOTtruetrue520231227_201425__91900.0007352954.698460[105, 344]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__InJulia__1SHOT__20231227_201425__919.json50.0missingmissingmissing
7974Apple-MacBook-Pro-M1ispersonalmistral-small--optimInJulia1SHOTtruetrue520231215_195306__50300.04.602420[105, 339]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__InJulia__1SHOT__20231215_195306__503.json50.00.9missing0.3
7975Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertAsk1SHOTtruetrue520231213_203026__44350.0006590023.926934[146, 291]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_203026__443.json100.0missingmissingmissing
7976Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertAsk1SHOTtruefalse520231225_193928__60000.0006861624.194240[146, 305]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_193928__600.json25.0missingmissingmissing
7977Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_193931__45150.0005135023.07594[146, 216]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_193931__451.json100.0missingmissingmissing
7978Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertAsk1SHOTtruefalse520231227_201414__33400.0006260223.742150[146, 274]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_201414__334.json25.0missingmissingmissing
7979Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertAsk1SHOTtruefalse520231227_201417__20100.0004902222.923790[146, 204]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_201417__201.json25.0missingmissingmissing
7980Apple-MacBook-Pro-M1ispersonalmistral-small--optimJuliaExpertAsk1SHOTtruefalse520231215_195302__42800.03.140090[146, 235]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_195302__428.json25.00.9missing0.3
7981Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertCoTTask1SHOTtruefalse520231213_203022__72300.000611823.430[220, 242]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203022__723.json25.0missingmissingmissing
7982Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_193918__49650.000922225.461764[220, 402]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193918__496.json100.0missingmissingmissing
7983Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertCoTTask1SHOTtruefalse520231225_193923__19600.00097465.854150[220, 429]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193923__196.json25.0missingmissingmissing
7984Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_201405__66750.00086795.074274[220, 374]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201405__667.json100.0missingmissingmissing
7985Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_201410__21550.000821344.783834[220, 350]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201410__215.json100.0missingmissingmissing
7986Apple-MacBook-Pro-M1ispersonalmistral-small--optimJuliaExpertCoTTask1SHOTtruefalse520231215_195259__30900.04.908010[220, 373]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195259__309.json25.00.9missing0.3
7987Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapCoTTask1SHOTtruefalse520231213_203046__30500.001075545.836790[412, 417]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203046__305.json25.0missingmissingmissing
7988Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapCoTTask1SHOTtruefalse520231225_194021__20400.001236566.856230[412, 500]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194021__204.json25.0missingmissingmissing
7989Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapCoTTask1SHOTtruefalse520231225_194028__21700.001308347.394870[412, 537]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194028__217.json25.0missingmissingmissing
7990Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapCoTTask1SHOTtruefalse520231227_201446__25000.0017584210.45490[412, 769]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201446__250.json25.0missingmissingmissing
7991Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_201500__25000.0014092213.98540[412, 589]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201500__250.json50.0missingmissingmissing
7992Apple-MacBook-Pro-M1ispersonalmistral-small--optimJuliaRecapCoTTask1SHOTtruefalse520231215_195325__42100.05.525020[412, 413]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195325__421.json25.00.9missing0.3
7993Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapTask1SHOTtruefalse520231213_203040__85000.001149916.270340[410, 456]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_203040__850.json25.0missingmissingmissing
7994Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapTask1SHOTtruetrue520231225_194008__77800.0012042315.85690[410, 484]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_194008__778.json50.0missingmissingmissing
7995Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapTask1SHOTtruetrue520231225_194014__95500.000981135.081230[410, 369]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_194014__955.json50.0missingmissingmissing
7996Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapTask1SHOTtruefalse520231227_201432__70000.001076196.083170[410, 418]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_201432__700.json25.0missingmissingmissing
7997Apple-MacBook-Pro-M1ispersonalmistral-smallJuliaRecapTask1SHOTtruefalse520231227_201436__41800.000802653.98540[410, 277]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_201436__418.json25.0missingmissingmissing
7998Apple-MacBook-Pro-M1ispersonalmistral-small--optimJuliaRecapTask1SHOTtruefalse520231215_195319__51800.06.629920[410, 493]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_195319__518.json25.00.9missing0.3
7999Apple-MacBook-Pro-M1ispersonalmistral-tinyAsIs1SHOTfalsefalse520231213_203006__65000.0001601465.58040[102, 322]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__AsIs__1SHOT__20231213_203006__650.json0.0missingmissingmissing
8000Apple-MacBook-Pro-M1ispersonalmistral-tinyAsIs1SHOTfalsefalse520231225_193853__90900.0001587872.836870[102, 319]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__AsIs__1SHOT__20231225_193853__909.json0.0missingmissingmissing
8001Apple-MacBook-Pro-M1ispersonalmistral-tinyAsIs1SHOTfalsefalse520231225_193857__88600.0002163183.910870[102, 446]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__AsIs__1SHOT__20231225_193857__886.json0.0missingmissingmissing
8002Apple-MacBook-Pro-M1ispersonalmistral-tiny--optimAsIs1SHOTfalsefalse520231215_195247__41500.02.579540[102, 296]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__AsIs__1SHOT__20231215_195247__415.json0.00.9missing0.3
8003Apple-MacBook-Pro-M1ispersonalmistral-tinyInJulia1SHOTfalsefalse520231213_203000__17300.0001809516.215620[105, 367]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__InJulia__1SHOT__20231213_203000__173.json0.0missingmissingmissing
8004Apple-MacBook-Pro-M1ispersonalmistral-tinyInJulia1SHOTtruefalse520231225_193846__64000.0001872933.369160[105, 381]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__InJulia__1SHOT__20231225_193846__640.json25.0missingmissingmissing
8005Apple-MacBook-Pro-M1ispersonalmistral-tinyInJulia1SHOTfalsefalse520231225_193850__77600.0001546773.449760[105, 309]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__InJulia__1SHOT__20231225_193850__776.json0.0missingmissingmissing
8006Apple-MacBook-Pro-M1ispersonalmistral-tinyInJulia1SHOTtruetrue520231227_201341__34120.0002076783.653812[105, 426]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__InJulia__1SHOT__20231227_201341__341.json72.5missingmissingmissing
8007Apple-MacBook-Pro-M1ispersonalmistral-tinyInJulia1SHOTtruefalse520231227_201345__99000.0001977123.499870[105, 404]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__InJulia__1SHOT__20231227_201345__990.json25.0missingmissingmissing
8008Apple-MacBook-Pro-M1ispersonalmistral-tiny--optimInJulia1SHOTtruetrue520231215_195244__54050.02.73874[105, 322]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__InJulia__1SHOT__20231215_195244__540.json100.00.9missing0.3
8009Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertAsk1SHOTtruefalse520231213_202954__84400.0001137583.949250[146, 206]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_202954__844.json25.0missingmissingmissing
8010Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_193842__33000.0001228182.042420[146, 226]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_193842__330.json0.0missingmissingmissing
8011Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_193843__56609.0202e-51.500770[146, 154]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_193843__566.json0.0missingmissingmissing
8012Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertAsk1SHOTtruefalse520231227_201335__17709.6997e-51.676620[146, 169]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_201335__177.json25.0missingmissingmissing
8013Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_201337__89730.0001046981.806834[146, 186]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_201337__897.json90.0missingmissingmissing
8014Apple-MacBook-Pro-M1ispersonalmistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_195241__54730.01.641164[146, 184]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_195241__547.json90.00.9missing0.3
8015Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231213_202950__88800.0002351038.798194[220, 451]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_202950__888.json75.0missingmissingmissing
8016Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_193836__72900.0001001096.53570[220, 153]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193836__729.json0.0missingmissingmissing
8017Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_193839__87050.0001630763.084974[220, 292]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_193839__870.json100.0missingmissingmissing
8018Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231227_201329__35800.000157648.659490[220, 280]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201329__358.json25.0missingmissingmissing
8019Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231227_201334__25100.0002727024.636880[220, 534]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201334__251.json0.0missingmissingmissing
8020Apple-MacBook-Pro-M1ispersonalmistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195239__87150.04.654114[220, 298]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195239__871.json100.00.9missing0.3
8021Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_203019__48650.0001822554.717684[412, 275]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203019__486.json100.0missingmissingmissing
8022Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231225_193908__88700.0002402393.737710[412, 403]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193908__887.json0.0missingmissingmissing
8023Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231225_193912__42800.0002021873.547730[412, 319]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_193912__428.json0.0missingmissingmissing
8024Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_201357__46550.0002289143.367544[412, 378]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201357__465.json100.0missingmissingmissing
8025Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapCoTTask1SHOTtruefalse520231227_201400__55300.0002035462.916960[412, 322]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201400__553.json25.0missingmissingmissing
8026Apple-MacBook-Pro-M1ispersonalmistral-tiny--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_195254__50800.03.392780[412, 398]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195254__508.json0.00.9missing0.3
8027Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapTask1SHOTfalsefalse520231213_203014__18800.0001901297.857980[410, 293]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_203014__188.json0.0missingmissingmissing
8028Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapTask1SHOTfalsefalse520231225_193900__50300.0002186683.198430[410, 356]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_193900__503.json0.0missingmissingmissing
8029Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapTask1SHOTfalsefalse520231225_193905__49300.0002671394.712540[410, 463]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_193905__493.json0.0missingmissingmissing
8030Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapTask1SHOTtruefalse520231227_201349__40200.0002603443.998320[410, 448]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_201349__402.json25.0missingmissingmissing
8031Apple-MacBook-Pro-M1ispersonalmistral-tinyJuliaRecapTask1SHOTtruefalse520231227_201354__94400.0003083624.899140[410, 554]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_201354__944.json25.0missingmissingmissing
8032Apple-MacBook-Pro-M1ispersonalmistral-tiny--optimJuliaRecapTask1SHOTtruefalse520231215_195250__39400.03.466420[410, 401]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_195250__394.json25.00.9missing0.3
8033Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_155755__72300.08.975730[101, 218]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_155755__723.json0.0missing{\n "num_gpu": 99\n}missing
8034Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_155802__47500.06.581960[101, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_155802__475.json0.0missing{\n "num_gpu": 99\n}missing
8035Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_155741__93900.05.102940[104, 117]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_155741__939.json25.0missing{\n "num_gpu": 99\n}missing
8036Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_155746__95000.05.676220[104, 132]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_155746__950.json25.0missing{\n "num_gpu": 99\n}missing
8037Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231227_010952__72400.05.047470[104, 115]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_010952__724.json25.0missing{\n "num_gpu": 99\n}missing
8038Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_155729__36400.08.613740[145, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155729__364.json25.0missing{\n "num_gpu": 99\n}missing
8039Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_155736__50300.06.331450[145, 144]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155736__503.json25.0missing{\n "num_gpu": 99\n}missing
8040Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_010947__66300.06.103350[145, 138]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_010947__663.json25.0missing{\n "num_gpu": 99\n}missing
8041Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_155716__32400.024.2520[219, 449]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155716__324.json25.0missing{\n "num_gpu": 99\n}missing
8042Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_155721__34000.04.001730[219, 74]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155721__340.json25.0missing{\n "num_gpu": 99\n}missing
8043Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_010941__27700.08.20670[219, 44]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_010941__277.json25.0missing{\n "num_gpu": 99\n}missing
8044Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_155855__22700.018.72050[412, 415]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155855__227.json0.0missing{\n "num_gpu": 99\n}missing
8045Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_155914__85100.019.38380[412, 431]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155914__851.json25.0missing{\n "num_gpu": 99\n}missing
8046Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_011027__25800.011.27510[412, 230]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011027__258.json25.0missing{\n "num_gpu": 99\n}missing
8047Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_155816__69900.014.11130[410, 302]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155816__699.json0.0missing{\n "num_gpu": 99\n}missing
8048Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_155836__36500.019.7550[410, 441]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155836__365.json25.0missing{\n "num_gpu": 99\n}missing
8049Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_011015__40300.023.63430[410, 532]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_011015__403.json25.0missing{\n "num_gpu": 99\n}missing
8050Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235109__90100.014.44490[103, 452]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235109__901.json25.0missing{\n "num_gpu": 99\n}missing
8051Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_235120__76800.010.39940[103, 323]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235120__768.json0.0missing{\n "num_gpu": 99\n}missing
8052Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_235130__61600.010.36110[103, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235130__616.json0.0missing{\n "num_gpu": 99\n}missing
8053Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231227_235148__53400.018.20840[103, 570]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235148__534.json25.0missing{\n "num_gpu": 99\n}missing
8054Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231227_235158__12000.09.516570[103, 294]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231227_235158__120.json0.0missing{\n "num_gpu": 99\n}missing
8055Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231227_235028__15500.06.226160[144, 182]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235028__155.json25.0missing{\n "num_gpu": 99\n}missing
8056Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231227_235034__73200.05.302380[144, 151]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235034__732.json25.0missing{\n "num_gpu": 99\n}missing
8057Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_235039__49400.05.44090[144, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235039__494.json0.0missing{\n "num_gpu": 99\n}missing
8058Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_235046__69200.06.788850[144, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235046__692.json0.0missing{\n "num_gpu": 99\n}missing
8059Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231227_235055__57500.09.116970[144, 274]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231227_235055__575.json0.0missing{\n "num_gpu": 99\n}missing
8060Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_234947__50400.010.0920[218, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234947__504.json0.0missing{\n "num_gpu": 99\n}missing
8061Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231227_234952__39550.05.039614[218, 132]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_234952__395.json100.0missing{\n "num_gpu": 99\n}missing
8062Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_235005__80900.012.62760[218, 374]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235005__809.json25.0missing{\n "num_gpu": 99\n}missing
8063Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231227_235012__72700.07.200250[218, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235012__727.json25.0missing{\n "num_gpu": 99\n}missing
8064Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231227_235022__43700.010.2570[218, 300]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235022__437.json0.0missing{\n "num_gpu": 99\n}missing
8065Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235332__29300.016.12250[411, 445]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235332__293.json25.0missing{\n "num_gpu": 99\n}missing
8066Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235343__57000.010.86570[411, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235343__570.json25.0missing{\n "num_gpu": 99\n}missing
8067Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235358__23400.014.98140[411, 410]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235358__234.json25.0missing{\n "num_gpu": 99\n}missing
8068Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231227_235414__49800.016.0950[411, 444]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235414__498.json0.0missing{\n "num_gpu": 99\n}missing
8069Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231227_235429__77700.014.44180[411, 393]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235429__777.json25.0missing{\n "num_gpu": 99\n}missing
8070Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231227_235214__21200.016.32240[409, 451]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235214__212.json50.0missing{\n "num_gpu": 99\n}missing
8071Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235231__37500.016.24420[409, 448]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235231__375.json25.0missing{\n "num_gpu": 99\n}missing
8072Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235245__93500.014.59140[409, 398]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235245__935.json25.0missing{\n "num_gpu": 99\n}missing
8073Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231227_235302__16900.016.53610[409, 457]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235302__169.json25.0missing{\n "num_gpu": 99\n}missing
8074Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231227_235316__42500.014.28290[409, 389]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231227_235316__425.json0.0missing{\n "num_gpu": 99\n}missing
8075Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231227_235613__96450.011.96544[103, 293]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235613__964.json100.0missing{\n "num_gpu": 99\n}missing
8076Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235626__65900.012.87260[103, 316]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235626__659.json25.0missing{\n "num_gpu": 99\n}missing
8077Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235640__68400.014.20750[103, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235640__684.json25.0missing{\n "num_gpu": 99\n}missing
8078Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235650__35900.010.17510[103, 247]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235650__359.json25.0missing{\n "num_gpu": 99\n}missing
8079Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231227_235707__40100.016.38440[103, 405]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231227_235707__401.json25.0missing{\n "num_gpu": 99\n}missing
8080Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_235530__77200.010.72640[144, 256]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235530__772.json0.0missing{\n "num_gpu": 99\n}missing
8081Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_235536__70000.05.950020[144, 133]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235536__700.json25.0missing{\n "num_gpu": 99\n}missing
8082Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_235543__47600.07.172920[144, 165]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235543__476.json25.0missing{\n "num_gpu": 99\n}missing
8083Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_235549__27530.05.944634[144, 133]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235549__275.json90.0missing{\n "num_gpu": 99\n}missing
8084Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_235601__27700.011.29210[144, 270]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_235601__277.json0.0missing{\n "num_gpu": 99\n}missing
8085Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_235447__64500.018.82930[218, 428]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235447__645.json25.0missing{\n "num_gpu": 99\n}missing
8086Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_235456__36400.08.827060[218, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235456__364.json25.0missing{\n "num_gpu": 99\n}missing
8087Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_235502__80650.06.060194[218, 126]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235502__806.json100.0missing{\n "num_gpu": 99\n}missing
8088Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_235510__85000.07.606730[218, 166]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235510__850.json0.0missing{\n "num_gpu": 99\n}missing
8089Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_235520__75500.09.616870[218, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_235520__755.json0.0missing{\n "num_gpu": 99\n}missing
8090Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_235854__79000.017.91690[411, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235854__790.json25.0missing{\n "num_gpu": 99\n}missing
8091Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_235918__94900.023.80770[411, 534]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235918__949.json0.0missing{\n "num_gpu": 99\n}missing
8092Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_235932__13400.014.03470[411, 297]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235932__134.json25.0missing{\n "num_gpu": 99\n}missing
8093Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_235947__61100.015.34990[411, 329]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_235947__611.json0.0missing{\n "num_gpu": 99\n}missing
8094Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231228_000005__77900.018.12080[411, 397]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000005__779.json0.0missing{\n "num_gpu": 99\n}missing
8095Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235723__54800.016.23630[409, 351]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235723__548.json25.0missing{\n "num_gpu": 99\n}missing
8096Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_235741__93900.017.71430[409, 387]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235741__939.json0.0missing{\n "num_gpu": 99\n}missing
8097Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_235800__61400.018.94990[409, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235800__614.json0.0missing{\n "num_gpu": 99\n}missing
8098Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235819__62700.019.06570[409, 420]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235819__627.json25.0missing{\n "num_gpu": 99\n}missing
8099Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_235836__43900.017.33350[409, 378]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_235836__439.json25.0missing{\n "num_gpu": 99\n}missing
8100Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_122451__32100.016.71820[100, 303]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_122451__321.json0.0missing{\n "num_gpu": 99\n}missing
8101Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_122508__71300.016.10530[100, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_122508__713.json0.0missing{\n "num_gpu": 99\n}missing
8102Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122418__47150.020.88994[103, 381]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122418__471.json100.0missing{\n "num_gpu": 99\n}missing
8103Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_122435__26700.016.27820[103, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122435__267.json25.0missing{\n "num_gpu": 99\n}missing
8104Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_011317__61050.015.03994[103, 271]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_011317__610.json100.0missing{\n "num_gpu": 99\n}missing
8105Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231226_122346__13500.08.24430[144, 140]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122346__135.json25.0missing{\n "num_gpu": 99\n}missing
8106Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231226_122357__63800.011.10030[144, 194]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122357__638.json25.0missing{\n "num_gpu": 99\n}missing
8107Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231227_011301__67100.08.69660[144, 148]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_011301__671.json25.0missing{\n "num_gpu": 99\n}missing
8108Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122327__24400.08.595420[218, 139]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122327__244.json50.0missing{\n "num_gpu": 99\n}missing
8109Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122338__31530.010.46124[218, 174]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122338__315.json90.0missing{\n "num_gpu": 99\n}missing
8110Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_011253__56200.017.34390[218, 135]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011253__562.json0.0missing{\n "num_gpu": 99\n}missing
8111Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_122624__39500.020.50470[411, 336]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122624__395.json0.0missing{\n "num_gpu": 99\n}missing
8112Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_122649__84100.025.47830[411, 426]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122649__841.json0.0missing{\n "num_gpu": 99\n}missing
8113Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_011418__72600.033.05790[411, 560]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011418__726.json25.0missing{\n "num_gpu": 99\n}missing
8114Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_122537__25500.029.83010[409, 504]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122537__255.json25.0missing{\n "num_gpu": 99\n}missing
8115Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_122603__75500.025.6310[409, 429]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122603__755.json25.0missing{\n "num_gpu": 99\n}missing
8116Apple-MacBook-Pro-M1ispersonalmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231227_011345__64800.028.00650[409, 470]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_011345__648.json25.0missing{\n "num_gpu": 99\n}missing
8117Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_121400__76700.040.71770[107, 219]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_121400__767.json25.0missing{\n "num_gpu": 99\n}missing
8118Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_121437__42250.036.56094[107, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_121437__422.json100.0missing{\n "num_gpu": 99\n}missing
8119Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_121531__83250.053.77174[107, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_121531__832.json100.0missing{\n "num_gpu": 99\n}missing
8120Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_152649__86600.036.71920[107, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_152649__866.json50.0missing{\n "num_gpu": 99\n}missing
8121Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_152725__52450.036.22574[107, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_152725__524.json100.0missing{\n "num_gpu": 99\n}missing
8122Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_121202__12900.030.8450[146, 161]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_121202__129.json0.0missing{\n "num_gpu": 99\n}missing
8123Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_121232__11450.030.3074[146, 163]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_121232__114.json100.0missing{\n "num_gpu": 99\n}missing
8124Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_121319__89350.047.10664[146, 264]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_121319__893.json100.0missing{\n "num_gpu": 99\n}missing
8125Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_152537__16750.027.77264[146, 147]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_152537__167.json100.0missing{\n "num_gpu": 99\n}missing
8126Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_152612__96000.035.15850[146, 192]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_152612__960.json50.0missing{\n "num_gpu": 99\n}missing
8127Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_120950__26750.065.51924[217, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_120950__267.json100.0missing{\n "num_gpu": 99\n}missing
8128Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_121042__37850.051.86984[217, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_121042__378.json100.0missing{\n "num_gpu": 99\n}missing
8129Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_121131__23600.048.72470[217, 255]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_121131__236.json25.0missing{\n "num_gpu": 99\n}missing
8130Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_152423__79200.058.18120[217, 319]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_152423__792.json25.0missing{\n "num_gpu": 99\n}missing
8131Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_152509__26550.045.76654[217, 245]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_152509__265.json100.0missing{\n "num_gpu": 99\n}missing
8132Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_121844__79150.069.45794[420, 342]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_121844__791.json100.0missing{\n "num_gpu": 99\n}missing
8133Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_121915__40900.030.20090[420, 109]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_121915__409.json0.0missing{\n "num_gpu": 99\n}missing
8134Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_122057__55800.0102.3660[420, 515]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122057__558.json25.0missing{\n "num_gpu": 99\n}missing
8135Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_153059__84400.084.89170[420, 434]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153059__844.json25.0missing{\n "num_gpu": 99\n}missing
8136Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_153138__90450.039.17124[420, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153138__904.json100.0missing{\n "num_gpu": 99\n}missing
8137Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_121614__47050.042.99764[418, 183]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_121614__470.json100.0missing{\n "num_gpu": 99\n}missing
8138Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_121656__18600.041.75960[418, 176]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_121656__186.json25.0missing{\n "num_gpu": 99\n}missing
8139Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_121735__36150.039.12054[418, 166]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_121735__361.json100.0missing{\n "num_gpu": 99\n}missing
8140Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_152824__24550.059.01044[418, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_152824__245.json100.0missing{\n "num_gpu": 99\n}missing
8141Apple-MacBook-Pro-M1ispersonalnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_152934__69600.069.4390[418, 345]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_152934__696.json50.0missing{\n "num_gpu": 99\n}missing
8142Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_160035__17400.016.99220[109, 423]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_160035__174.json0.0missing{\n "num_gpu": 99\n}missing
8143Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_160046__52400.010.81290[109, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_160046__524.json0.0missing{\n "num_gpu": 99\n}missing
8144Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_160008__58550.012.0024[112, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_160008__585.json100.0missing{\n "num_gpu": 99\n}missing
8145Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_160018__65950.010.57564[112, 259]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_160018__659.json100.0missing{\n "num_gpu": 99\n}missing
8146Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231227_011110__35800.012.79410[112, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_011110__358.json0.0missing{\n "num_gpu": 99\n}missing
8147Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_155946__41200.08.136610[153, 191]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155946__412.json25.0missing{\n "num_gpu": 99\n}missing
8148Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_155956__72200.09.13240[153, 216]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155956__722.json50.0missing{\n "num_gpu": 99\n}missing
8149Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_011057__35200.09.345270[153, 221]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_011057__352.json50.0missing{\n "num_gpu": 99\n}missing
8150Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_155928__48050.014.08814[227, 166]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155928__480.json100.0missing{\n "num_gpu": 99\n}missing
8151Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_155938__55350.09.824964[227, 220]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155938__553.json100.0missing{\n "num_gpu": 99\n}missing
8152Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_011048__54700.020.74390[227, 339]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011048__547.json25.0missing{\n "num_gpu": 99\n}missing
8153Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_160138__84600.017.38650[420, 378]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160138__846.json50.0missing{\n "num_gpu": 99\n}missing
8154Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_160202__20600.023.78564[420, 533]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160202__206.json75.0missing{\n "num_gpu": 99\n}missing
8155Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_011145__89700.018.69380[420, 408]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011145__897.json0.0missing{\n "num_gpu": 99\n}missing
8156Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_160104__56900.017.5390[418, 382]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_160104__569.json25.0missing{\n "num_gpu": 99\n}missing
8157Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_160121__10100.017.11880[418, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_160121__101.json25.0missing{\n "num_gpu": 99\n}missing
8158Apple-MacBook-Pro-M1ispersonalopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_011126__39950.015.85694[418, 339]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_011126__399.json100.0missing{\n "num_gpu": 99\n}missing
8159Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_073540__14200.014.88620[96, 434]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_073540__142.json0.0missingmissingmissing
8160Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_150903__32700.08.605550[107, 271]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_150903__327.json0.0missing{\n "num_gpu": 99\n}missing
8161Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_150916__61900.013.04820[107, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_150916__619.json0.0missing{\n "num_gpu": 99\n}missing
8162Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTfalsefalse520231214_073525__82300.023.53770[113, 664]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_073525__823.json0.0missingmissingmissing
8163Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTfalsefalse520231225_150846__68500.07.523480[110, 235]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_150846__685.json0.0missing{\n "num_gpu": 99\n}missing
8164Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTfalsefalse520231225_150855__34800.08.863330[110, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_150855__348.json0.0missing{\n "num_gpu": 99\n}missing
8165Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralInJulia1SHOTfalsefalse520231227_004535__58300.010.6780[110, 337]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_004535__583.json0.0missing{\n "num_gpu": 99\n}missing
8166Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231214_073502__99900.012.66610[142, 353]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_073502__999.json0.0missingmissingmissing
8167Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231225_150831__63700.06.082510[151, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_150831__637.json0.0missing{\n "num_gpu": 99\n}missing
8168Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231225_150838__80300.07.063580[151, 213]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_150838__803.json25.0missing{\n "num_gpu": 99\n}missing
8169Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231227_004524__41900.07.577850[151, 230]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_004524__419.json25.0missing{\n "num_gpu": 99\n}missing
8170Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_073449__69800.017.56310[217, 462]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073449__698.json25.0missingmissingmissing
8171Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231225_150813__25100.010.59980[225, 143]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150813__251.json0.0missing{\n "num_gpu": 99\n}missing
8172Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231225_150825__37300.011.86280[225, 354]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_150825__373.json25.0missing{\n "num_gpu": 99\n}missing
8173Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231227_004517__95300.017.1570[225, 363]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004517__953.json0.0missing{\n "num_gpu": 99\n}missing
8174Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231214_073626__92500.025.08380[11, 659]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073626__925.json25.0missingmissingmissing
8175Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_150950__75400.010.27120[418, 268]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_150950__754.json25.0missing{\n "num_gpu": 99\n}missing
8176Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231225_151006__31200.016.20160[418, 452]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_151006__312.json0.0missing{\n "num_gpu": 99\n}missing
8177Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_004602__94650.010.96324[418, 288]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004602__946.json100.0missing{\n "num_gpu": 99\n}missing
8178Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231214_073600__89600.020.2740[413, 449]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_073600__896.json25.0missingmissingmissing
8179Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_150925__45900.08.836160[416, 227]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_150925__459.json25.0missing{\n "num_gpu": 99\n}missing
8180Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_150939__80200.014.12210[416, 393]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_150939__802.json25.0missing{\n "num_gpu": 99\n}missing
8181Apple-MacBook-Pro-M1ispersonalopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231227_004551__21800.016.08760[416, 451]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_004551__218.json0.0missing{\n "num_gpu": 99\n}missing
8182Apple-MacBook-Pro-M1ispersonalorca2:13bAsIs1SHOTfalsefalse520231214_074815__39500.012.17220[96, 356]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__AsIs__1SHOT__20231214_074815__395.json0.0missingmissingmissing
8183Apple-MacBook-Pro-M1ispersonalorca2:13bAsIs1SHOTfalsefalse520231225_153040__56500.02.189340[113, 22]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__AsIs__1SHOT__20231225_153040__565.json0.0missing{\n "num_gpu": 99\n}missing
8184Apple-MacBook-Pro-M1ispersonalorca2:13bAsIs1SHOTfalsefalse520231225_153056__47800.015.89030[113, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__AsIs__1SHOT__20231225_153056__478.json0.0missing{\n "num_gpu": 99\n}missing
8185Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTtruefalse520231214_074803__73300.012.84170[113, 370]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231214_074803__733.json25.0missingmissingmissing
8186Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTtruetrue520231225_153029__31000.011.94240[116, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231225_153029__310.json50.0missing{\n "num_gpu": 99\n}missing
8187Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTfalsefalse520231225_153038__80400.09.03080[116, 153]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231225_153038__804.json0.0missing{\n "num_gpu": 99\n}missing
8188Apple-MacBook-Pro-M1ispersonalorca2:13bInJulia1SHOTtruetrue520231227_005603__26300.013.82330[116, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__InJulia__1SHOT__20231227_005603__263.json50.0missing{\n "num_gpu": 99\n}missing
8189Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231214_074750__21500.09.328740[142, 255]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_074750__215.json0.0missingmissingmissing
8190Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_153005__15000.04.164750[155, 55]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_153005__150.json0.0missing{\n "num_gpu": 99\n}missing
8191Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_153017__62500.011.66330[155, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_153017__625.json0.0missing{\n "num_gpu": 99\n}missing
8192Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_005550__19600.06.208770[155, 94]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_005550__196.json0.0missing{\n "num_gpu": 99\n}missing
8193Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231214_074740__88600.016.23540[217, 426]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074740__886.json25.0missingmissingmissing
8194Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_152942__53200.027.99050[230, 310]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152942__532.json50.0missing{\n "num_gpu": 99\n}missing
8195Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_153001__21200.019.6010[230, 328]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_153001__212.json0.0missing{\n "num_gpu": 99\n}missing
8196Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231227_005543__63900.037.89650[230, 493]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005543__639.json25.0missing{\n "num_gpu": 99\n}missing
8197Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231214_074913__51600.024.36480[11, 643]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074913__516.json0.0missingmissingmissing
8198Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_153221__27000.026.39580[419, 410]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_153221__270.json0.0missing{\n "num_gpu": 99\n}missing
8199Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231225_153247__21400.026.2390[419, 407]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_153247__214.json25.0missing{\n "num_gpu": 99\n}missing
8200Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_005650__38400.020.47330[419, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005650__384.json0.0missing{\n "num_gpu": 99\n}missing
8201Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTfalsefalse520231214_074849__56700.034.0820[413, 787]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_074849__567.json0.0missingmissingmissing
8202Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTtruefalse520231225_153120__95300.024.02390[416, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_153120__953.json25.0missing{\n "num_gpu": 99\n}missing
8203Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_153154__18300.033.91530[416, 543]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_153154__183.json0.0missing{\n "num_gpu": 99\n}missing
8204Apple-MacBook-Pro-M1ispersonalorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_005629__78500.025.81940[416, 402]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_005629__785.json0.0missing{\n "num_gpu": 99\n}missing
8205Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_160317__87500.07.752870[97, 296]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_160317__875.json0.0missing{\n "num_gpu": 99\n}missing
8206Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_160338__39100.021.10740[97, 787]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_160338__391.json0.0missing{\n "num_gpu": 99\n}missing
8207Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_160249__54300.022.5050[100, 835]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_160249__543.json0.0missing{\n "num_gpu": 99\n}missing
8208Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_160310__23400.020.89450[100, 779]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_160310__234.json0.0missing{\n "num_gpu": 99\n}missing
8209Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_011218__74000.014.86520[100, 560]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_011218__740.json0.0missing{\n "num_gpu": 99\n}missing
8210Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_160214__20500.06.423650[137, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_160214__205.json0.0missing{\n "num_gpu": 99\n}missing
8211Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_160226__69400.011.87930[137, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_160226__694.json0.0missing{\n "num_gpu": 99\n}missing
8212Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_011203__56000.014.33230[137, 533]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_011203__560.json0.0missing{\n "num_gpu": 99\n}missing
8213Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_160207__58300.04.38990[209, 2]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160207__583.json0.0missing{\n "num_gpu": 99\n}missing
8214Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_160208__44200.00.9157090[209, 11]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_160208__442.json0.0missing{\n "num_gpu": 99\n}missing
8215Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_011149__28800.04.343520[209, 10]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011149__288.json0.0missing{\n "num_gpu": 99\n}missing
8216Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_160413__22900.08.930360[389, 286]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160413__229.json0.0missing{\n "num_gpu": 99\n}missing
8217Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_160424__83000.010.83220[389, 354]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_160424__830.json0.0missing{\n "num_gpu": 99\n}missing
8218Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_011235__98200.08.256120[389, 259]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011235__982.json0.0missing{\n "num_gpu": 99\n}missing
8219Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_160351__45300.012.40[386, 410]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_160351__453.json0.0missing{\n "num_gpu": 99\n}missing
8220Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_160404__61800.012.85880[386, 427]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_160404__618.json0.0missing{\n "num_gpu": 99\n}missing
8221Apple-MacBook-Pro-M1ispersonalphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_011227__52100.09.08660[386, 290]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_011227__521.json0.0missing{\n "num_gpu": 99\n}missing
8222Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_075021__63000.014.96280[96, 436]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_075021__630.json0.0missingmissingmissing
8223Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_153709__48400.045.54140[121, 349]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_153709__484.json0.0missing{\n "num_gpu": 99\n}missing
8224Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_153746__62200.036.63440[121, 278]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_153746__622.json0.0missing{\n "num_gpu": 99\n}missing
8225Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTfalsefalse520231214_075006__88300.015.53070[113, 446]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_075006__883.json0.0missingmissingmissing
8226Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruefalse520231225_153545__85500.034.29470[124, 259]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_153545__855.json25.0missing{\n "num_gpu": 99\n}missing
8227Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_153623__84100.038.30170[124, 291]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_153623__841.json50.0missing{\n "num_gpu": 99\n}missing
8228Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2InJulia1SHOTtruefalse520231227_005918__11900.056.70[124, 432]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_005918__119.json25.0missing{\n "num_gpu": 99\n}missing
8229Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_074950__38600.017.91480[142, 500]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_074950__386.json0.0missingmissingmissing
8230Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_153432__72600.028.29640[163, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_153432__726.json50.0missing{\n "num_gpu": 99\n}missing
8231Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruefalse520231225_153511__76000.038.16920[163, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_153511__760.json25.0missing{\n "num_gpu": 99\n}missing
8232Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_005821__52700.027.48330[163, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_005821__527.json50.0missing{\n "num_gpu": 99\n}missing
8233Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_074932__83300.018.71330[217, 494]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074932__833.json0.0missingmissingmissing
8234Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_153334__12950.046.84634[238, 160]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_153334__129.json100.0missing{\n "num_gpu": 99\n}missing
8235Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_153404__37250.030.07184[238, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_153404__372.json100.0missing{\n "num_gpu": 99\n}missing
8236Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231227_005754__98000.064.15160[238, 307]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005754__980.json25.0missing{\n "num_gpu": 99\n}missing
8237Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231214_075120__17400.025.89880[11, 679]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075120__174.json50.0missingmissingmissing
8238Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_153947__10800.049.58440[427, 318]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_153947__108.json50.0missing{\n "num_gpu": 99\n}missing
8239Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_154029__48500.041.37160[427, 254]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_154029__485.json50.0missing{\n "num_gpu": 99\n}missing
8240Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_010125__99000.062.41560[427, 412]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_010125__990.json50.0missing{\n "num_gpu": 99\n}missing
8241Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231214_075054__80100.033.38060[413, 771]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_075054__801.json25.0missingmissingmissing
8242Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_153816__69900.030.62520[424, 172]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_153816__699.json50.0missing{\n "num_gpu": 99\n}missing
8243Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_153857__75900.040.61020[424, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_153857__759.json50.0missing{\n "num_gpu": 99\n}missing
8244Apple-MacBook-Pro-M1ispersonalphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_010022__45100.063.97430[424, 427]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_010022__451.json50.0missing{\n "num_gpu": 99\n}missing
8245Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_155504__28900.025.89390[109, 435]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_155504__289.json0.0missing{\n "num_gpu": 99\n}missing
8246Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_155517__16700.012.96660[109, 212]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_155517__167.json0.0missing{\n "num_gpu": 99\n}missing
8247Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231225_155417__82200.024.8340[112, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_155417__822.json25.0missing{\n "num_gpu": 99\n}missing
8248Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231225_155438__61200.020.78020[112, 347]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_155438__612.json0.0missing{\n "num_gpu": 99\n}missing
8249Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231227_010850__76800.021.84880[112, 364]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_010850__768.json0.0missing{\n "num_gpu": 99\n}missing
8250Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_155341__56000.014.83030[153, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155341__560.json0.0missing{\n "num_gpu": 99\n}missing
8251Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_155353__32000.011.33180[153, 178]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_155353__320.json0.0missing{\n "num_gpu": 99\n}missing
8252Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_010829__77700.012.57690[153, 199]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_010829__777.json0.0missing{\n "num_gpu": 99\n}missing
8253Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_155315__24800.020.04530[227, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155315__248.json0.0missing{\n "num_gpu": 99\n}missing
8254Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_155326__87100.011.49740[227, 167]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_155326__871.json0.0missing{\n "num_gpu": 99\n}missing
8255Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_010816__29600.026.65560[227, 278]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_010816__296.json0.0missing{\n "num_gpu": 99\n}missing
8256Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_155621__43700.020.06420[420, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155621__437.json0.0missing{\n "num_gpu": 99\n}missing
8257Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_155652__24400.030.73660[420, 459]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_155652__244.json0.0missing{\n "num_gpu": 99\n}missing
8258Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_010932__80800.022.9180[420, 329]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_010932__808.json0.0missing{\n "num_gpu": 99\n}missing
8259Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_155536__41200.018.75330[418, 261]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155536__412.json0.0missing{\n "num_gpu": 99\n}missing
8260Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_155601__64100.025.57850[418, 375]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_155601__641.json0.0missing{\n "num_gpu": 99\n}missing
8261Apple-MacBook-Pro-M1ispersonalsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_010909__17200.018.92630[418, 263]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_010909__172.json0.0missing{\n "num_gpu": 99\n}missing
8262Apple-MacBook-Pro-M1ispersonalstablelm-zephyrAsIs1SHOTfalsefalse520231214_074634__31500.014.05950[96, 410]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_074634__315.json0.0missingmissingmissing
8263Apple-MacBook-Pro-M1ispersonalstablelm-zephyrAsIs1SHOTfalsefalse520231225_152843__64200.04.031410[110, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_152843__642.json0.0missing{\n "num_gpu": 99\n}missing
8264Apple-MacBook-Pro-M1ispersonalstablelm-zephyrAsIs1SHOTfalsefalse520231225_152847__24000.04.070550[110, 226]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_152847__240.json0.0missing{\n "num_gpu": 99\n}missing
8265Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231214_074620__86600.014.88850[113, 428]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_074620__866.json0.0missingmissingmissing
8266Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231225_152831__17900.05.606490[113, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_152831__179.json0.0missing{\n "num_gpu": 99\n}missing
8267Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231225_152838__31800.06.955340[113, 388]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_152838__318.json0.0missing{\n "num_gpu": 99\n}missing
8268Apple-MacBook-Pro-M1ispersonalstablelm-zephyrInJulia1SHOTfalsefalse520231227_005447__94400.08.172570[113, 450]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_005447__944.json0.0missing{\n "num_gpu": 99\n}missing
8269Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_074605__35000.09.501680[142, 261]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_074605__350.json0.0missingmissingmissing
8270Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_152818__37800.05.964260[150, 325]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_152818__378.json0.0missing{\n "num_gpu": 99\n}missing
8271Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_152826__42800.08.299830[150, 452]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_152826__428.json0.0missing{\n "num_gpu": 99\n}missing
8272Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertAsk1SHOTtruefalse520231227_005439__11700.09.604220[150, 515]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_005439__117.json25.0missing{\n "num_gpu": 99\n}missing
8273Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231214_074555__77800.015.34580[217, 402]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_074555__778.json25.0missingmissingmissing
8274Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_152805__34000.010.35070[220, 391]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152805__340.json0.0missing{\n "num_gpu": 99\n}missing
8275Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_152812__99700.06.215820[220, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_152812__997.json0.0missing{\n "num_gpu": 99\n}missing
8276Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_005429__99500.09.057950[220, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_005429__995.json0.0missing{\n "num_gpu": 99\n}missing
8277Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_074724__91100.027.61630[11, 721]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_074724__911.json0.0missingmissingmissing
8278Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_152908__98100.06.266130[400, 275]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152908__981.json25.0missing{\n "num_gpu": 99\n}missing
8279Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_152914__72400.05.590330[400, 240]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152914__724.json0.0missing{\n "num_gpu": 99\n}missing
8280Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_005505__13200.07.629890[400, 342]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005505__132.json0.0missing{\n "num_gpu": 99\n}missing
8281Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231214_074656__16100.022.64540[413, 510]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_074656__161.json25.0missingmissingmissing
8282Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_152855__49900.08.696090[398, 399]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_152855__499.json25.0missing{\n "num_gpu": 99\n}missing
8283Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_152902__63500.06.424820[398, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_152902__635.json0.0missing{\n "num_gpu": 99\n}missing
8284Apple-MacBook-Pro-M1ispersonalstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_005458__73700.010.71130[398, 494]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_005458__737.json0.0missing{\n "num_gpu": 99\n}missing
8285Apple-MacBook-Pro-M1ispersonalstarling-lm:latestAsIs1SHOTfalsefalse520231214_073710__38900.016.86840[96, 489]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_073710__389.json0.0missingmissingmissing
8286Apple-MacBook-Pro-M1ispersonalstarling-lm:latestAsIs1SHOTfalsefalse520231225_151122__79400.011.02570[109, 349]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_151122__794.json0.0missing{\n "num_gpu": 99\n}missing
8287Apple-MacBook-Pro-M1ispersonalstarling-lm:latestAsIs1SHOTfalsefalse520231225_151131__49200.08.923180[109, 281]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_151131__492.json0.0missing{\n "num_gpu": 99\n}missing
8288Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTtruefalse520231214_073653__83600.012.59010[113, 363]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_073653__836.json25.0missingmissingmissing
8289Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTfalsefalse520231225_151057__33200.08.896590[112, 280]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_151057__332.json0.0missing{\n "num_gpu": 99\n}missing
8290Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTtruetrue520231225_151110__30800.013.42020[112, 427]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_151110__308.json50.0missing{\n "num_gpu": 99\n}missing
8291Apple-MacBook-Pro-M1ispersonalstarling-lm:latestInJulia1SHOTfalsefalse520231227_004632__40600.07.85590[112, 244]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_004632__406.json0.0missing{\n "num_gpu": 99\n}missing
8292Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231214_073640__69000.06.97440[142, 185]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_073640__690.json25.0missingmissingmissing
8293Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231225_151037__82400.09.70040[153, 300]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_151037__824.json25.0missing{\n "num_gpu": 99\n}missing
8294Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231225_151048__16600.011.32510[153, 353]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_151048__166.json0.0missing{\n "num_gpu": 99\n}missing
8295Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_004624__45300.010.73860[153, 332]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_004624__453.json50.0missing{\n "num_gpu": 99\n}missing
8296Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_073633__70400.07.439550[217, 176]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073633__704.json0.0missingmissingmissing
8297Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231225_151022__21500.015.57280[227, 302]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151022__215.json0.0missing{\n "num_gpu": 99\n}missing
8298Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_151027__30700.05.239070[227, 137]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151027__307.json50.0missing{\n "num_gpu": 99\n}missing
8299Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231227_004614__73900.011.36670[227, 169]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004614__739.json0.0missing{\n "num_gpu": 99\n}missing
8300Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231214_073756__15700.020.32550[11, 543]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073756__157.json25.0missingmissingmissing
8301Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231225_151207__28900.011.64280[420, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_151207__289.json0.0missing{\n "num_gpu": 99\n}missing
8302Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231225_151220__37900.012.92660[420, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_151220__379.json0.0missing{\n "num_gpu": 99\n}missing
8303Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_004652__89200.010.63620[420, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_004652__892.json50.0missing{\n "num_gpu": 99\n}missing
8304Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231214_073736__33300.026.48570[413, 605]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_073736__333.json0.0missingmissingmissing
8305Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231225_151145__98800.014.42380[418, 397]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_151145__988.json0.0missing{\n "num_gpu": 99\n}missing
8306Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTtruefalse520231225_151155__83900.010.18270[418, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_151155__839.json25.0missing{\n "num_gpu": 99\n}missing
8307Apple-MacBook-Pro-M1ispersonalstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231227_004642__15600.09.520750[418, 242]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_004642__156.json0.0missing{\n "num_gpu": 99\n}missing
8308Apple-MacBook-Pro-M1ispersonalyi:34b-chatAsIs1SHOTfalsefalse520231214_073848__65600.09.755220[96, 285]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_073848__656.json0.0missingmissingmissing
8309Apple-MacBook-Pro-M1ispersonalyi:34b-chatAsIs1SHOTfalsefalse520231225_151627__39800.051.59390[104, 384]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_151627__398.json0.0missing{\n "num_gpu": 99\n}missing
8310Apple-MacBook-Pro-M1ispersonalyi:34b-chatAsIs1SHOTfalsefalse520231225_151734__32800.066.77090[104, 499]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_151734__328.json0.0missing{\n "num_gpu": 99\n}missing
8311Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruefalse520231214_073838__12000.014.42590[113, 415]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_073838__120.json25.0missingmissingmissing
8312Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruetrue520231225_151446__49850.039.82284[107, 293]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_151446__498.json100.0missing{\n "num_gpu": 99\n}missing
8313Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruefalse520231225_151535__82600.048.80080[107, 362]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_151535__826.json25.0missing{\n "num_gpu": 99\n}missing
8314Apple-MacBook-Pro-M1ispersonalyi:34b-chatInJulia1SHOTtruefalse520231227_004855__98100.071.99640[107, 537]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_004855__981.json25.0missing{\n "num_gpu": 99\n}missing
8315Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231214_073824__55400.011.67210[142, 324]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_073824__554.json25.0missingmissingmissing
8316Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_151341__26000.022.96430[146, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_151341__260.json25.0missing{\n "num_gpu": 99\n}missing
8317Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231225_151406__94800.025.13580[146, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_151406__948.json25.0missing{\n "num_gpu": 99\n}missing
8318Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231227_004743__59800.021.82470[146, 147]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_004743__598.json25.0missing{\n "num_gpu": 99\n}missing
8319Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231214_073812__22600.015.77430[217, 413]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_073812__226.json0.0missingmissingmissing
8320Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_151300__42200.040.00070[217, 76]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151300__422.json25.0missing{\n "num_gpu": 99\n}missing
8321Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231225_151318__66400.018.39430[217, 109]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_151318__664.json25.0missing{\n "num_gpu": 99\n}missing
8322Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231227_004721__76100.028.3810[217, 11]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_004721__761.json0.0missing{\n "num_gpu": 99\n}missing
8323Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_073938__36000.025.10370[11, 661]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_073938__360.json0.0missingmissingmissing
8324Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_152004__90950.043.67454[420, 262]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152004__909.json100.0missing{\n "num_gpu": 99\n}missing
8325Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_152122__17100.077.80060[420, 512]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_152122__171.json25.0missing{\n "num_gpu": 99\n}missing
8326Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231227_005151__79600.089.90020[420, 597]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_005151__796.json25.0missing{\n "num_gpu": 99\n}missing
8327Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTtruefalse520231214_073913__99200.024.55220[413, 557]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_073913__992.json25.0missingmissingmissing
8328Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTtruefalse520231225_151835__51500.061.27110[418, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_151835__515.json25.0missing{\n "num_gpu": 99\n}missing
8329Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_151920__87350.045.39654[418, 275]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_151920__873.json100.0missing{\n "num_gpu": 99\n}missing
8330Apple-MacBook-Pro-M1ispersonalyi:34b-chatJuliaRecapTask1SHOTfalsefalse520231227_005021__31300.086.39580[418, 573]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/ispersonal/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_005021__313.json0.0missing{\n "num_gpu": 99\n}missing
8331Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructAsIs1SHOTfalsefalse520231214_075659__39800.06.498220[52, 197]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_075659__398.json0.0missingmissingmissing
8332Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructAsIs1SHOTfalsefalse520231225_115314__68900.02.256850[74, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_115314__689.json0.0missing{\n "num_gpu": 99\n}missing
8333Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructAsIs1SHOTfalsefalse520231225_115319__59100.04.543710[74, 73]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_115319__591.json0.0missing{\n "num_gpu": 99\n}missing
8334Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTfalsefalse520231214_075653__86000.010.71230[69, 320]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_075653__860.json0.0missingmissingmissing
8335Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruetrue520231225_115301__25230.010.00624[77, 178]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_115301__252.json90.0missing{\n "num_gpu": 99\n}missing
8336Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruetrue520231225_115312__71810.010.62324[77, 190]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_115312__718.json80.0missing{\n "num_gpu": 99\n}missing
8337Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructInJulia1SHOTtruetrue520231227_012209__40730.010.99134[77, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_012209__407.json90.0missing{\n "num_gpu": 99\n}missing
8338Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_075642__35510.08.594614[98, 246]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_075642__355.json80.0missingmissingmissing
8339Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_115243__60750.012.37164[115, 218]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_115243__607.json100.0missing{\n "num_gpu": 99\n}missing
8340Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_115251__42130.07.509324[115, 125]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_115251__421.json90.0missing{\n "num_gpu": 99\n}missing
8341Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_012158__73350.06.438464[115, 104]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_012158__733.json100.0missing{\n "num_gpu": 99\n}missing
8342Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231214_075634__36900.011.530[188, 305]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075634__369.json0.0missingmissingmissing
8343Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_115224__70100.014.64420[206, 59]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115224__701.json0.0missing{\n "num_gpu": 99\n}missing
8344Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_115231__24620.06.397344[206, 88]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115231__246.json85.0missing{\n "num_gpu": 99\n}missing
8345Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231227_012151__72100.012.61920[206, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012151__721.json0.0missing{\n "num_gpu": 99\n}missing
8346Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231214_075730__30400.017.77950[11, 485]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075730__304.json0.0missingmissingmissing
8347Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse520231225_115407__61600.017.48610[380, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115407__616.json0.0missing{\n "num_gpu": 99\n}missing
8348Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_115426__31730.018.89384[380, 290]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115426__317.json90.0missing{\n "num_gpu": 99\n}missing
8349Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_012234__34930.016.76664[380, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012234__349.json90.0missing{\n "num_gpu": 99\n}missing
8350Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_075712__18500.012.87980[369, 273]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_075712__185.json0.0missingmissingmissing
8351Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_115335__18400.016.69280[377, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_115335__184.json50.0missing{\n "num_gpu": 99\n}missing
8352Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_115350__14750.014.20064[377, 206]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_115350__147.json100.0missing{\n "num_gpu": 99\n}missing
8353Apple-MacBook-Pro-M1keep_only_namescodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_012217__82950.08.204084[377, 95]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_012217__829.json100.0missing{\n "num_gpu": 99\n}missing
8354NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_021927__66310.00.4980884[0, 38]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_021927__663.json80.0missing{\n "num_gpu": 99\n}missing
8355NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_021929__84050.02.598344[0, 198]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_021929__840.json100.0missing{\n "num_gpu": 99\n}missing
8356NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_021932__48110.02.306794[0, 176]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_021932__481.json80.0missing{\n "num_gpu": 99\n}missing
8357NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_021933__32250.01.629584[0, 125]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_021933__322.json100.0missing{\n "num_gpu": 99\n}missing
8358NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_021935__42250.01.32124[0, 101]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_021935__422.json100.0missing{\n "num_gpu": 99\n}missing
8359NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_021910__10350.00.5262874[0, 40]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_021910__103.json100.0missing{\n "num_gpu": 99\n}missing
8360NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_021910__32950.00.5525024[0, 42]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_021910__329.json100.0missing{\n "num_gpu": 99\n}missing
8361NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_021911__61350.00.5523994[0, 42]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_021911__613.json100.0missing{\n "num_gpu": 99\n}missing
8362NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_021913__95730.02.277914[0, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_021913__957.json90.0missing{\n "num_gpu": 99\n}missing
8363NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_021914__13650.00.525854[0, 40]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_021914__136.json100.0missing{\n "num_gpu": 99\n}missing
8364NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_021903__39200.00.4240360[0, 32]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021903__392.json0.0missing{\n "num_gpu": 99\n}missing
8365NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_021903__81300.00.4362120[0, 33]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021903__813.json0.0missing{\n "num_gpu": 99\n}missing
8366NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_021904__30200.00.436570[0, 33]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021904__302.json0.0missing{\n "num_gpu": 99\n}missing
8367NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_021904__44100.00.4179960[0, 31]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021904__441.json0.0missing{\n "num_gpu": 99\n}missing
8368NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_021904__69700.00.4314880[0, 31]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021904__697.json0.0missing{\n "num_gpu": 99\n}missing
8369NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022021__78920.02.248184[0, 163]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022021__789.json85.0missing{\n "num_gpu": 99\n}missing
8370NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_022022__30600.01.497720[0, 109]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022022__306.json0.0missing{\n "num_gpu": 99\n}missing
8371NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_022024__86800.01.377110[0, 100]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022024__868.json0.0missing{\n "num_gpu": 99\n}missing
8372NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022026__55020.02.260374[0, 164]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022026__550.json85.0missing{\n "num_gpu": 99\n}missing
8373NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022029__45650.03.043344[0, 220]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022029__456.json100.0missing{\n "num_gpu": 99\n}missing
8374NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_021958__48210.02.931780[0, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_021958__482.json55.0missing{\n "num_gpu": 99\n}missing
8375NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_022000__66800.01.679470[0, 125]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022000__668.json0.0missing{\n "num_gpu": 99\n}missing
8376NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022003__12630.03.943644[0, 291]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022003__126.json90.0missing{\n "num_gpu": 99\n}missing
8377NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022004__23100.00.5840644[0, 43]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022004__231.json75.0missing{\n "num_gpu": 99\n}missing
8378NVIDIA-RTX-4090-4xkeep_only_namescodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022005__90500.00.58194[0, 43]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022005__905.json75.0missing{\n "num_gpu": 99\n}missing
8379Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonAsIs1SHOTfalsefalse520231214_075815__29200.09.104820[52, 277]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_075815__292.json0.0missingmissingmissing
8380Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonAsIs1SHOTfalsefalse520231225_115508__43500.08.219520[48, 149]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_115508__435.json0.0missing{\n "num_gpu": 99\n}missing
8381Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonAsIs1SHOTfalsefalse520231225_115512__92100.03.289330[48, 54]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_115512__921.json0.0missing{\n "num_gpu": 99\n}missing
8382Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonInJulia1SHOTtruetrue520231214_075806__36010.09.694650[69, 289]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_075806__360.json55.0missingmissingmissing
8383Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonInJulia1SHOTfalsefalse520231225_115456__60800.04.017780[51, 68]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_115456__608.json0.0missing{\n "num_gpu": 99\n}missing
8384Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonInJulia1SHOTfalsefalse520231225_115500__43600.04.487620[51, 77]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_115500__436.json0.0missing{\n "num_gpu": 99\n}missing
8385Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231214_075756__80410.06.536980[98, 184]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_075756__804.json55.0missingmissingmissing
8386Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_115445__55800.02.387130[52, 36]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_115445__558.json0.0missing{\n "num_gpu": 99\n}missing
8387Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_115452__74300.06.920080[52, 124]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_115452__743.json0.0missing{\n "num_gpu": 99\n}missing
8388Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231214_075750__40100.019.50670[188, 527]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075750__401.json0.0missingmissingmissing
8389Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_115439__14900.012.75310[81, 37]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115439__149.json0.0missing{\n "num_gpu": 99\n}missing
8390Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_115442__75700.03.122040[81, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115442__757.json0.0missing{\n "num_gpu": 99\n}missing
8391Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_075851__10200.019.30530[11, 525]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075851__102.json50.0missingmissingmissing
8392Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_115526__37600.01.362460[69, 11]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115526__376.json0.0missing{\n "num_gpu": 99\n}missing
8393Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_115532__92600.06.561860[69, 112]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115532__926.json0.0missing{\n "num_gpu": 99\n}missing
8394Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_075832__70800.016.67630[369, 375]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_075832__708.json0.0missingmissingmissing
8395Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_115517__96800.05.36880[66, 89]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_115517__968.json0.0missing{\n "num_gpu": 99\n}missing
8396Apple-MacBook-Pro-M1keep_only_namescodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_115525__39500.07.391240[66, 128]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_115525__395.json0.0missing{\n "num_gpu": 99\n}missing
8397NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_022319__61800.06.966540[0, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022319__618.json0.0missing{\n "num_gpu": 99\n}missing
8398NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_022325__38200.06.067390[0, 216]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022325__382.json50.0missing{\n "num_gpu": 99\n}missing
8399NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_022331__98430.05.297584[0, 192]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022331__984.json90.0missing{\n "num_gpu": 99\n}missing
8400NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_022339__15750.08.092134[0, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022339__157.json100.0missing{\n "num_gpu": 99\n}missing
8401NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_022349__71430.010.59434[0, 382]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022349__714.json90.0missing{\n "num_gpu": 99\n}missing
8402NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_022236__73150.05.687854[0, 201]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022236__731.json100.0missing{\n "num_gpu": 99\n}missing
8403NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_022240__29330.03.733144[0, 134]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022240__293.json90.0missing{\n "num_gpu": 99\n}missing
8404NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022240__74500.00.7548370[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022240__745.json0.0missing{\n "num_gpu": 99\n}missing
8405NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022241__45500.00.7590220[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022241__455.json0.0missing{\n "num_gpu": 99\n}missing
8406NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022242__15700.01.078580[0, 39]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022242__157.json0.0missing{\n "num_gpu": 99\n}missing
8407NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022202__79400.01.219690[0, 44]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022202__794.json0.0missing{\n "num_gpu": 99\n}missing
8408NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_022209__43950.07.485584[0, 269]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022209__439.json100.0missing{\n "num_gpu": 99\n}missing
8409NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022212__44200.02.108830[0, 76]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022212__442.json0.0missing{\n "num_gpu": 99\n}missing
8410NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022212__87800.00.7489790[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022212__878.json0.0missing{\n "num_gpu": 99\n}missing
8411NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022213__86300.00.7495590[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022213__863.json0.0missing{\n "num_gpu": 99\n}missing
8412NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_022409__93000.00.1144330[0, 4]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022409__930.json0.0missing{\n "num_gpu": 99\n}missing
8413NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_022410__20700.00.1144410[0, 4]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022410__207.json0.0missing{\n "num_gpu": 99\n}missing
8414NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022414__45810.04.697020[0, 168]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022414__458.json55.0missing{\n "num_gpu": 99\n}missing
8415NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_022415__69300.00.9823010[0, 35]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022415__693.json0.0missing{\n "num_gpu": 99\n}missing
8416NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_022417__26400.01.596440[0, 57]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022417__264.json0.0missing{\n "num_gpu": 99\n}missing
8417NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_022403__98900.02.978570[0, 105]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022403__989.json0.0missing{\n "num_gpu": 99\n}missing
8418NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_022404__58900.00.7976740[0, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022404__589.json0.0missing{\n "num_gpu": 99\n}missing
8419NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_022405__66300.00.7864750[0, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022405__663.json0.0missing{\n "num_gpu": 99\n}missing
8420NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022407__75740.01.83984[0, 66]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022407__757.json95.0missing{\n "num_gpu": 99\n}missing
8421NVIDIA-RTX-4090-4xkeep_only_namescodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_022409__36200.01.875690[0, 67]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022409__362.json0.0missing{\n "num_gpu": 99\n}missing
8422NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_021343__28750.018.11534[0, 445]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_021343__287.json100.0missing{\n "num_gpu": 99\n}missing
8423NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KInJulia1SHOTtruefalse520240201_021400__96000.016.59280[0, 408]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_021400__960.json25.0missing{\n "num_gpu": 99\n}missing
8424NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_021414__59850.013.89224[0, 342]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_021414__598.json100.0missing{\n "num_gpu": 99\n}missing
8425NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_021434__42800.020.03980[0, 490]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_021434__428.json0.0missing{\n "num_gpu": 99\n}missing
8426NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KInJulia1SHOTtruefalse520240201_021445__64100.011.56240[0, 282]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_021445__641.json25.0missing{\n "num_gpu": 99\n}missing
8427NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_021220__62900.010.91630[0, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_021220__629.json0.0missing{\n "num_gpu": 99\n}missing
8428NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_021224__13600.03.941540[0, 96]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_021224__136.json0.0missing{\n "num_gpu": 99\n}missing
8429NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_021231__19600.06.404340[0, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_021231__196.json0.0missing{\n "num_gpu": 99\n}missing
8430NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_021236__76300.05.903470[0, 145]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_021236__763.json50.0missing{\n "num_gpu": 99\n}missing
8431NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_021246__62900.09.060110[0, 223]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_021246__629.json0.0missing{\n "num_gpu": 99\n}missing
8432NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_021100__64800.010.36850[0, 254]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021100__648.json0.0missing{\n "num_gpu": 99\n}missing
8433NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_021107__28500.06.708080[0, 161]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021107__285.json0.0missing{\n "num_gpu": 99\n}missing
8434NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_021125__12050.018.40494[0, 438]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021125__120.json100.0missing{\n "num_gpu": 99\n}missing
8435NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_021129__68700.03.653120[0, 88]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021129__687.json0.0missing{\n "num_gpu": 99\n}missing
8436NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_021134__98500.05.029350[0, 121]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_021134__985.json0.0missing{\n "num_gpu": 99\n}missing
8437NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_021734__40900.03.693640[0, 90]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_021734__409.json0.0missing{\n "num_gpu": 99\n}missing
8438NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_021746__73400.011.37090[0, 276]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_021746__734.json0.0missing{\n "num_gpu": 99\n}missing
8439NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_021756__29600.010.46920[0, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_021756__296.json0.0missing{\n "num_gpu": 99\n}missing
8440NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_021829__68400.032.91344[0, 790]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_021829__684.json75.0missing{\n "num_gpu": 99\n}missing
8441NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_021846__63700.016.88240[0, 406]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_021846__637.json0.0missing{\n "num_gpu": 99\n}missing
8442NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_021606__38900.036.84970[0, 888]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_021606__389.json50.0missing{\n "num_gpu": 99\n}missing
8443NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_021621__44350.015.39144[0, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_021621__443.json100.0missing{\n "num_gpu": 99\n}missing
8444NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_021630__25750.08.175344[0, 199]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_021630__257.json100.0missing{\n "num_gpu": 99\n}missing
8445NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_021639__16630.09.504984[0, 231]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_021639__166.json90.0missing{\n "num_gpu": 99\n}missing
8446NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_021645__87000.05.52450[0, 135]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_021645__870.json0.0missing{\n "num_gpu": 99\n}missing
8447NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_020507__58700.014.90[0, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_020507__587.json0.0missing{\n "num_gpu": 99\n}missing
8448NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_020521__44550.014.68184[0, 275]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_020521__445.json100.0missing{\n "num_gpu": 99\n}missing
8449NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_020535__51250.013.4754[0, 252]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_020535__512.json100.0missing{\n "num_gpu": 99\n}missing
8450NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_020547__64450.011.69014[0, 219]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_020547__644.json100.0missing{\n "num_gpu": 99\n}missing
8451NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_020557__73450.010.48254[0, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_020557__734.json100.0missing{\n "num_gpu": 99\n}missing
8452NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_020325__60300.019.60120[0, 366]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_020325__603.json0.0missing{\n "num_gpu": 99\n}missing
8453NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_020333__13330.07.844614[0, 147]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_020333__133.json90.0missing{\n "num_gpu": 99\n}missing
8454NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_020342__20050.09.13214[0, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_020342__200.json100.0missing{\n "num_gpu": 99\n}missing
8455NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_020353__32200.011.58860[0, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_020353__322.json25.0missing{\n "num_gpu": 99\n}missing
8456NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_020400__53400.06.720430[0, 126]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_020400__534.json0.0missing{\n "num_gpu": 99\n}missing
8457NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_020133__68350.012.21454[0, 228]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_020133__683.json100.0missing{\n "num_gpu": 99\n}missing
8458NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_020141__31150.08.031194[0, 150]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_020141__311.json100.0missing{\n "num_gpu": 99\n}missing
8459NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_020150__29210.09.0524[0, 169]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_020150__292.json80.0missing{\n "num_gpu": 99\n}missing
8460NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_020202__54800.011.84540[0, 221]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_020202__548.json0.0missing{\n "num_gpu": 99\n}missing
8461NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_020208__13450.06.636344[0, 124]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_020208__134.json100.0missing{\n "num_gpu": 99\n}missing
8462NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_020853__63550.09.127894[0, 168]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_020853__635.json100.0missing{\n "num_gpu": 99\n}missing
8463NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_020902__87430.09.425244[0, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_020902__874.json90.0missing{\n "num_gpu": 99\n}missing
8464NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_020911__55530.08.658194[0, 160]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_020911__555.json90.0missing{\n "num_gpu": 99\n}missing
8465NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_020923__94500.012.15180[0, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_020923__945.json0.0missing{\n "num_gpu": 99\n}missing
8466NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_020935__16600.011.97790[0, 221]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_020935__166.json0.0missing{\n "num_gpu": 99\n}missing
8467NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_020710__40150.011.02134[0, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_020710__401.json100.0missing{\n "num_gpu": 99\n}missing
8468NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_020719__55900.08.401140[0, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_020719__559.json0.0missing{\n "num_gpu": 99\n}missing
8469NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_020727__35000.07.853670[0, 146]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_020727__350.json0.0missing{\n "num_gpu": 99\n}missing
8470NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_020740__64650.013.49994[0, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_020740__646.json100.0missing{\n "num_gpu": 99\n}missing
8471NVIDIA-RTX-4090-4xkeep_only_namescodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_020748__27340.07.314664[0, 136]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_020748__273.json95.0missing{\n "num_gpu": 99\n}missing
8472NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_022046__59400.00.254060[0, 31]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022046__594.json0.0missing{\n "num_gpu": 99\n}missing
8473NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_022046__91200.00.2545960[0, 31]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022046__912.json0.0missing{\n "num_gpu": 99\n}missing
8474NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_022047__31300.00.2568880[0, 31]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022047__313.json0.0missing{\n "num_gpu": 99\n}missing
8475NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_022047__85800.00.6293970[0, 77]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022047__858.json0.0missing{\n "num_gpu": 99\n}missing
8476NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_022048__15700.00.630780[0, 77]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_022048__157.json0.0missing{\n "num_gpu": 99\n}missing
8477NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022041__25400.00.2402350[0, 29]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022041__254.json0.0missing{\n "num_gpu": 99\n}missing
8478NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022042__39000.00.2248120[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022042__390.json0.0missing{\n "num_gpu": 99\n}missing
8479NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_022042__56810.01.446070[0, 175]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022042__568.json55.0missing{\n "num_gpu": 99\n}missing
8480NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022043__12800.00.2403720[0, 29]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022043__128.json0.0missing{\n "num_gpu": 99\n}missing
8481NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_022043__78500.00.2234040[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_022043__785.json0.0missing{\n "num_gpu": 99\n}missing
8482NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022037__82300.00.2342670[0, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022037__823.json0.0missing{\n "num_gpu": 99\n}missing
8483NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022038__15300.00.3078840[0, 37]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022038__153.json0.0missing{\n "num_gpu": 99\n}missing
8484NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022038__25100.00.3071820[0, 37]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022038__251.json0.0missing{\n "num_gpu": 99\n}missing
8485NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022038__26200.00.2253250[0, 27]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022038__262.json0.0missing{\n "num_gpu": 99\n}missing
8486NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022038__57100.00.3077540[0, 37]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022038__571.json0.0missing{\n "num_gpu": 99\n}missing
8487NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022124__78050.01.969684[0, 236]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022124__780.json100.0missing{\n "num_gpu": 99\n}missing
8488NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022125__14510.01.193210[0, 143]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022125__145.json55.0missing{\n "num_gpu": 99\n}missing
8489NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022128__71410.02.660010[0, 317]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022128__714.json55.0missing{\n "num_gpu": 99\n}missing
8490NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022130__35310.01.859340[0, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022130__353.json55.0missing{\n "num_gpu": 99\n}missing
8491NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_022132__89850.02.289734[0, 270]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_022132__898.json100.0missing{\n "num_gpu": 99\n}missing
8492NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_022100__33000.02.23390[0, 257]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022100__330.json25.0missing{\n "num_gpu": 99\n}missing
8493NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022101__95210.01.930924[0, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022101__952.json80.0missing{\n "num_gpu": 99\n}missing
8494NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_022104__78900.02.914290[0, 334]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022104__789.json0.0missing{\n "num_gpu": 99\n}missing
8495NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022106__81210.02.01354[0, 232]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022106__812.json80.0missing{\n "num_gpu": 99\n}missing
8496NVIDIA-RTX-4090-4xkeep_only_namescodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_022108__68750.01.43314[0, 163]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_022108__687.json100.0missing{\n "num_gpu": 99\n}missing
8497Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_121147__10200.029.4330[67, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_121147__102.json0.0missing{\n "num_gpu": 99\n}missing
8498Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_121208__95300.020.84320[67, 119]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_121208__953.json0.0missing{\n "num_gpu": 99\n}missing
8499Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121031__75950.022.41664[70, 129]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121031__759.json100.0missing{\n "num_gpu": 99\n}missing
8500Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121117__51110.045.10290[70, 272]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121117__511.json55.0missing{\n "num_gpu": 99\n}missing
8501Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_013007__62650.032.91274[70, 195]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_013007__626.json100.0missing{\n "num_gpu": 99\n}missing
8502Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_120946__32100.032.21840[111, 185]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_120946__321.json0.0missing{\n "num_gpu": 99\n}missing
8503Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_121009__47000.022.66710[111, 125]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121009__470.json0.0missing{\n "num_gpu": 99\n}missing
8504Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_012934__90200.08.157280[111, 33]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_012934__902.json0.0missing{\n "num_gpu": 99\n}missing
8505Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_120844__61100.052.6340[201, 136]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120844__611.json0.0missing{\n "num_gpu": 99\n}missing
8506Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_120914__21000.030.09260[201, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120914__210.json0.0missing{\n "num_gpu": 99\n}missing
8507Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_012926__41800.052.63610[201, 151]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012926__418.json0.0missing{\n "num_gpu": 99\n}missing
8508Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121406__31040.035.74234[399, 159]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121406__310.json95.0missing{\n "num_gpu": 99\n}missing
8509Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121446__56800.040.29360[399, 187]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121446__568.json50.0missing{\n "num_gpu": 99\n}missing
8510Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013125__33730.046.66544[399, 225]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013125__337.json90.0missing{\n "num_gpu": 99\n}missing
8511Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121257__53050.049.49354[397, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121257__530.json100.0missing{\n "num_gpu": 99\n}missing
8512Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121330__11530.032.30434[397, 138]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121330__115.json90.0missing{\n "num_gpu": 99\n}missing
8513Apple-MacBook-Pro-M1keep_only_namesdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013038__83630.030.21534[397, 125]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013038__836.json90.0missing{\n "num_gpu": 99\n}missing
8514Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_013649__44300.05.202290[71, 199]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_013649__443.json50.0missing{\n "num_gpu": 99\n}missing
8515Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_122137__59200.08.170880[71, 315]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_122137__592.json50.0missing{\n "num_gpu": 99\n}missing
8516Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_122143__93600.05.288450[71, 203]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_122143__936.json50.0missing{\n "num_gpu": 99\n}missing
8517Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_122150__59100.07.488930[71, 287]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_122150__591.json50.0missing{\n "num_gpu": 99\n}missing
8518Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_013644__22400.06.338720[108, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_013644__224.json50.0missing{\n "num_gpu": 99\n}missing
8519Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_122118__68600.05.141390[108, 191]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_122118__686.json50.0missing{\n "num_gpu": 99\n}missing
8520Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_122124__17430.05.518184[108, 203]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_122124__174.json90.0missing{\n "num_gpu": 99\n}missing
8521Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_122129__55200.05.120590[108, 191]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_122129__552.json50.0missing{\n "num_gpu": 99\n}missing
8522Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_013637__20600.05.121790[196, 44]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013637__206.json50.0missing{\n "num_gpu": 99\n}missing
8523Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_122106__66900.08.330830[196, 165]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122106__669.json0.0missing{\n "num_gpu": 99\n}missing
8524Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_122107__71500.01.783430[196, 46]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122107__715.json50.0missing{\n "num_gpu": 99\n}missing
8525Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_122113__90900.04.976840[196, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122113__909.json25.0missing{\n "num_gpu": 99\n}missing
8526Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_013658__45400.04.951560[360, 143]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013658__454.json50.0missing{\n "num_gpu": 99\n}missing
8527Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_122231__10300.010.62994[360, 351]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122231__103.json75.0missing{\n "num_gpu": 99\n}missing
8528Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_122241__64800.09.95920[360, 326]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122241__648.json25.0missing{\n "num_gpu": 99\n}missing
8529Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_122248__78800.07.340040[360, 230]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_122248__788.json0.0missing{\n "num_gpu": 99\n}missing
8530Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_013653__69900.04.006860[357, 108]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_013653__699.json50.0missing{\n "num_gpu": 99\n}missing
8531Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_122203__14410.013.010[357, 434]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_122203__144.json55.0missing{\n "num_gpu": 99\n}missing
8532Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_122214__34800.010.0710[357, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_122214__348.json0.0missing{\n "num_gpu": 99\n}missing
8533Apple-MacBook-Pro-M1keep_only_namesdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_122220__42700.06.539030[357, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_122220__427.json50.0missing{\n "num_gpu": 99\n}missing
8534Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_111205__19100.02.400420[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111205__191.json50.0missingmissingmissing
8535Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_111209__64600.03.895124[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111209__646.json75.0missingmissingmissing
8536Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_111211__81300.02.069660[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111211__813.json25.0missingmissingmissing
8537Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_111215__29630.03.303834[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111215__296.json90.0missingmissingmissing
8538Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_111217__15010.02.307290[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111217__150.json55.0missingmissingmissing
8539Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111139__46510.01.927250[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111139__465.json55.0missingmissingmissing
8540Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111142__50210.02.41150[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111142__502.json55.0missingmissingmissing
8541Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111144__94310.02.448760[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111144__943.json55.0missingmissingmissing
8542Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111147__94510.02.76030[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111147__945.json55.0missingmissingmissing
8543Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111150__61900.02.597270[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111150__619.json50.0missingmissingmissing
8544Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111112__65950.03.091244[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111112__659.json100.0missingmissingmissing
8545Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_111116__63300.03.29250[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111116__633.json0.0missingmissingmissing
8546Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111118__72030.02.200264[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111118__720.json90.0missingmissingmissing
8547Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111121__46420.02.638794[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111121__464.json85.0missingmissingmissing
8548Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_111125__98600.04.240240[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111125__986.json25.0missingmissingmissing
8549Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111316__88400.03.199990[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111316__884.json25.0missingmissingmissing
8550Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_111318__59910.02.744330[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111318__599.json55.0missingmissingmissing
8551Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111321__13200.02.086550[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111321__132.json25.0missingmissingmissing
8552Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111324__62100.03.218550[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111324__621.json25.0missingmissingmissing
8553Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111326__94200.01.898730[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111326__942.json25.0missingmissingmissing
8554Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_111243__10400.04.053350[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111243__104.json25.0missingmissingmissing
8555Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_111245__68500.02.06920[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111245__685.json50.0missingmissingmissing
8556Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_111252__32200.06.855830[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111252__322.json25.0missingmissingmissing
8557Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_111256__38200.04.040[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111256__382.json0.0missingmissingmissing
8558Apple-MacBook-Pro-M1keep_only_namesgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_111258__66830.01.87394[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111258__668.json90.0missingmissingmissing
8559Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_234044__47600.011.83260[0, 180]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_234044__476.json25.0missingmissingmissing
8560Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_234107__74200.023.57350[0, 364]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_234107__742.json25.0missingmissingmissing
8561Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_234119__91400.011.68620[0, 177]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_234119__914.json25.0missingmissingmissing
8562Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_234134__24700.014.95470[0, 228]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_234134__247.json0.0missingmissingmissing
8563Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KInJulia1SHOTtruefalse520240223_234149__83000.014.94590[0, 227]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_234149__830.json25.0missingmissingmissing
8564Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_233847__83810.010.58730[0, 162]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_233847__838.json55.0missingmissingmissing
8565Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_233902__44310.014.70090[0, 225]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_233902__443.json55.0missingmissingmissing
8566Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_233904__77210.02.030170[0, 32]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_233904__772.json55.0missingmissingmissing
8567Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_233912__12910.08.248820[0, 125]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_233912__129.json55.0missingmissingmissing
8568Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_233915__95700.03.044160[0, 46]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_233915__957.json50.0missingmissingmissing
8569Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_233613__59900.022.71770[0, 347]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_233613__599.json25.0missingmissingmissing
8570Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_233634__46200.020.66210[0, 317]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_233634__462.json25.0missingmissingmissing
8571Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_233658__32200.023.76930[0, 360]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_233658__322.json25.0missingmissingmissing
8572Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_233717__80300.019.05070[0, 290]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_233717__803.json25.0missingmissingmissing
8573Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_233742__98200.024.72910[0, 380]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_233742__982.json25.0missingmissingmissing
8574Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_234746__82750.020.66164[0, 310]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_234746__827.json100.0missingmissingmissing
8575Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_234803__66010.017.02930[0, 258]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_234803__660.json55.0missingmissingmissing
8576Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_234821__23300.018.3210[0, 279]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_234821__233.json50.0missingmissingmissing
8577Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_234843__81710.021.16540[0, 322]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_234843__817.json55.0missingmissingmissing
8578Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240223_234901__14310.018.0324[0, 277]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240223_234901__143.json80.0missingmissingmissing
8579Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_234408__87400.027.33380[0, 412]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_234408__874.json50.0missingmissingmissing
8580Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_234429__17410.020.82360[0, 318]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_234429__174.json55.0missingmissingmissing
8581Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_234452__28210.023.10530[0, 347]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_234452__282.json55.0missingmissingmissing
8582Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240223_234514__99300.021.24050[0, 324]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_234514__993.json0.0missingmissingmissing
8583Apple-MacBook-Pro-M1keep_only_namesgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240223_234533__53250.018.80774[0, 283]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240223_234533__532.json100.0missingmissingmissing
8584Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboAsIs1SHOTfalsefalse520231213_203244__67600.0003567.683030[61, 217]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_203244__676.json0.0missingmissingmissing
8585Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboAsIs1SHOTfalsefalse520231225_194342__98800.0003023.116640[61, 181]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_194342__988.json0.0missingmissingmissing
8586Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboAsIs1SHOTfalsefalse520231225_194344__18000.00018952.282310[61, 106]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_194344__180.json0.0missingmissingmissing
8587Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_195546__93900.04.402460[61, 214]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_195546__939.json0.00.5missing0.5
8588Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboInJulia1SHOTtruetrue520231213_203236__86800.0002333.633520[64, 134]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_203236__868.json50.0missingmissingmissing
8589Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboInJulia1SHOTtruetrue520231225_194335__86350.00025852.906814[64, 151]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_194335__863.json100.0missingmissingmissing
8590Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboInJulia1SHOTtruetrue520231225_194339__67850.00034553.086314[64, 209]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_194339__678.json100.0missingmissingmissing
8591Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboInJulia1SHOTtruetrue520231227_201810__28350.00025252.753614[64, 147]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_201810__283.json100.0missingmissingmissing
8592Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboInJulia1SHOTtruetrue520231227_201812__87350.00017151.748014[64, 93]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_201812__873.json100.0missingmissingmissing
8593Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_195541__61950.04.54034[64, 203]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_195541__619.json100.00.5missing0.5
8594Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_203232__20618.7e-51.143120[99, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_203232__206.json55.0missingmissingmissing
8595Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_194331__26850.00027152.563434[99, 148]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_194331__268.json100.0missingmissingmissing
8596Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_194332__66950.00016651.711714[99, 78]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_194332__669.json100.0missingmissingmissing
8597Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_201805__92818.85e-50.6789640[99, 26]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_201805__928.json55.0missingmissingmissing
8598Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_201807__65850.0001771.749734[99, 85]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_201807__658.json100.0missingmissingmissing
8599Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_195536__58150.01.028014[99, 25]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_195536__581.json100.00.5missing0.5
8600Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_203231__23200.0001992.442760[173, 75]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203231__232.json0.0missingmissingmissing
8601Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_194326__36050.0002742.279344[173, 125]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194326__360.json100.0missingmissingmissing
8602Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_194328__33900.00025151.830510[173, 110]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194328__339.json0.0missingmissingmissing
8603Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_201801__47400.00020651.925180[173, 80]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201801__474.json0.0missingmissingmissing
8604Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_201804__41150.00033553.36184[173, 166]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201804__411.json100.0missingmissingmissing
8605Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_195535__36100.01.541210[173, 55]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195535__361.json0.00.5missing0.5
8606Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231213_203251__13310.0003675.203530[323, 137]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203251__133.json55.0missingmissingmissing
8607Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_194352__96900.0003612.197750[323, 133]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194352__969.json0.0missingmissingmissing
8608Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_194354__20900.00023651.241450[323, 50]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194354__209.json0.0missingmissingmissing
8609Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_201817__13600.00024852.074020[323, 58]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201817__136.json0.0missingmissingmissing
8610Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_201821__89050.00048253.501974[323, 214]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201821__890.json100.0missingmissingmissing
8611Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue520231215_195552__79710.04.73590[323, 236]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195552__797.json55.00.5missing0.5
8612Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_203246__44100.00022851.940470[322, 45]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_203246__441.json0.0missingmissingmissing
8613Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231225_194349__86210.00046254.503570[322, 201]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_194349__862.json55.0missingmissingmissing
8614Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_194350__86700.00026451.44510[322, 69]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_194350__867.json0.0missingmissingmissing
8615Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_201814__91900.00035752.16410[322, 131]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_201814__919.json0.0missingmissingmissing
8616Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_201815__45300.0002451.536340[322, 56]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_201815__453.json0.0missingmissingmissing
8617Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_195547__28300.01.40590[322, 44]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_195547__283.json0.00.5missing0.5
8618Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200537__67950.00020151.133874[64, 113]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200537__679.json100.0missingmissingmissing
8619Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200538__19850.00023751.060484[64, 137]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200538__198.json100.0missingmissingmissing
8620Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200540__42250.00023151.307314[64, 133]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200540__422.json100.0missingmissingmissing
8621Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200541__47950.0001970.8971834[64, 110]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200541__479.json100.0missingmissingmissing
8622Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200542__94850.00021651.085594[64, 123]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200542__948.json100.0missingmissingmissing
8623Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200534__20658.7e-50.4561954[99, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200534__206.json100.0missingmissingmissing
8624Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200534__33559.3e-50.503414[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200534__335.json100.0missingmissingmissing
8625Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200535__24959.3e-50.464544[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200535__249.json100.0missingmissingmissing
8626Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200535__63959.3e-50.6368044[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200535__639.json100.0missingmissingmissing
8627Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200536__43858.7e-50.6213254[99, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200536__438.json100.0missingmissingmissing
8628Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200529__30350.0003461.52174[173, 173]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200529__303.json100.0missingmissingmissing
8629Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200530__87150.00018550.7308214[173, 66]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200530__871.json100.0missingmissingmissing
8630Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200530__91300.0002140.8472520[173, 85]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200530__913.json0.0missingmissingmissing
8631Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200532__19450.00037151.494214[173, 190]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200532__194.json100.0missingmissingmissing
8632Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200533__38350.0002411.086764[173, 103]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200533__383.json100.0missingmissingmissing
8633Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200547__82430.00021550.753684[323, 36]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200547__824.json90.0missingmissingmissing
8634Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200547__97900.00029650.7852560[323, 90]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200547__979.json0.0missingmissingmissing
8635Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200548__29100.000220.4903980[323, 39]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200548__291.json0.0missingmissingmissing
8636Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruetrue520240201_200548__80000.00021850.5286350[323, 38]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200548__800.json50.0missingmissingmissing
8637Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200550__90600.00029951.093310[323, 92]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200550__906.json0.0missingmissingmissing
8638Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200542__56730.0002120.4711494[322, 34]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200542__567.json90.0missingmissingmissing
8639Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200543__36830.0003471.064394[322, 124]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200543__368.json90.0missingmissingmissing
8640Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200544__58450.00029450.8288844[322, 89]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200544__584.json100.0missingmissingmissing
8641Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200545__31740.00021950.4890824[322, 39]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200545__317.json95.0missingmissingmissing
8642Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200546__32630.0003351.029084[322, 116]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200546__326.json90.0missingmissingmissing
8643Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_203259__96700.0002832.800750[61, 111]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_203259__967.json0.0missingmissingmissing
8644Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_194403__67000.0002451.524450[61, 92]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_194403__670.json0.0missingmissingmissing
8645Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_194405__31900.0003551.869860[61, 147]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_194405__319.json0.0missingmissingmissing
8646Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_195601__10600.02.789020[61, 130]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_195601__106.json0.00.9missing0.1
8647Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_203256__35150.0003442.994374[64, 140]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_203256__351.json100.0missingmissingmissing
8648Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_194359__37850.0003041.730194[64, 120]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_194359__378.json100.0missingmissingmissing
8649Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_194402__92950.000351.980074[64, 143]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_194402__929.json100.0missingmissingmissing
8650Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_201829__49850.0003182.436534[64, 127]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_201829__498.json100.0missingmissingmissing
8651Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_201831__54150.0003022.417474[64, 119]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_201831__541.json100.0missingmissingmissing
8652Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_195558__24850.03.073794[64, 131]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_195558__248.json100.00.9missing0.1
8653Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_203253__41650.0001470.6217454[99, 24]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_203253__416.json100.0missingmissingmissing
8654Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_194357__93210.0001490.5554980[99, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_194357__932.json55.0missingmissingmissing
8655Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_194358__99030.0001550.8778574[99, 28]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_194358__990.json90.0missingmissingmissing
8656Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_201825__69350.0001490.9036144[99, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_201825__693.json100.0missingmissingmissing
8657Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_201826__98850.0001571.081944[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_201826__988.json100.0missingmissingmissing
8658Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_195555__67650.01.697584[99, 29]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_195555__676.json100.00.9missing0.1
8659Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_203252__94650.0002690.9569964[173, 48]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203252__946.json100.0missingmissingmissing
8660Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_194355__67750.0002630.9123354[173, 45]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194355__677.json100.0missingmissingmissing
8661Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_194356__28250.0002631.009664[173, 45]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194356__282.json100.0missingmissingmissing
8662Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_201822__78750.0002551.387134[173, 41]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201822__787.json100.0missingmissingmissing
8663Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTfalsefalse520231227_201824__77100.0002931.476280[173, 60]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201824__771.json0.0missingmissingmissing
8664Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195553__88750.00.924664[173, 48]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195553__887.json100.00.9missing0.1
8665Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231213_203304__67030.0006073.664234[323, 142]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203304__670.json90.0missingmissingmissing
8666Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231225_194409__41800.0005392.018130[323, 108]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194409__418.json50.0missingmissingmissing
8667Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_194411__47500.0004471.101040[323, 62]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194411__475.json0.0missingmissingmissing
8668Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_201836__81700.0004671.533280[323, 72]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201836__817.json0.0missingmissingmissing
8669Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231227_201838__21750.0005712.457564[323, 124]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_201838__217.json100.0missingmissingmissing
8670Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_195603__44500.01.492670[323, 63]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195603__445.json0.00.9missing0.1
8671Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_203300__86110.0003820.696250[322, 30]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_203300__861.json55.0missingmissingmissing
8672Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruefalse520231225_194407__60900.0004461.427030[322, 62]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_194407__609.json25.0missingmissingmissing
8673Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_194407__91530.0003780.5912694[322, 28]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_194407__915.json90.0missingmissingmissing
8674Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_201833__10950.0003721.053034[322, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_201833__109.json100.0missingmissingmissing
8675Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_201834__56100.000461.497610[322, 69]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_201834__561.json0.0missingmissingmissing
8676Apple-MacBook-Pro-M1keep_only_namesgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_195602__82130.01.036414[322, 36]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_195602__821.json90.00.9missing0.1
8677Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewInJulia1SHOTtruetrue520240201_101604__67850.0060112.70634[64, 179]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_101604__678.json100.0missingmissingmissing
8678Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewInJulia1SHOTtruetrue520240201_101626__17930.0091621.5544[64, 284]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_101626__179.json90.0missingmissingmissing
8679Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewInJulia1SHOTtruetrue520240201_101654__46550.0093728.49794[64, 291]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_101654__465.json100.0missingmissingmissing
8680Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewInJulia1SHOTtruetrue520240201_101718__81350.0097623.93014[64, 304]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_101718__813.json100.0missingmissingmissing
8681Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewInJulia1SHOTtruetrue520240201_101733__19150.0087414.23884[64, 270]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_101733__191.json100.0missingmissingmissing
8682Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_101333__37150.001863.019414[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_101333__371.json100.0missingmissingmissing
8683Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_101336__83750.001862.857464[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_101336__837.json100.0missingmissingmissing
8684Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_101339__92450.001712.816144[99, 24]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_101339__924.json100.0missingmissingmissing
8685Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_101342__44350.001742.67934[99, 25]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_101342__443.json100.0missingmissingmissing
8686Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_101345__36950.001863.506644[99, 29]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_101345__369.json100.0missingmissingmissing
8687Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_101216__82530.0084818.17244[173, 225]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_101216__825.json90.0missingmissingmissing
8688Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_101230__23750.0063214.48124[173, 153]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_101230__237.json100.0missingmissingmissing
8689Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_101253__68130.0093522.38064[173, 254]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_101253__681.json90.0missingmissingmissing
8690Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_101307__94600.005913.95330[173, 139]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_101307__946.json25.0missingmissingmissing
8691Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse520240201_101318__79700.0056310.83950[173, 130]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_101318__797.json0.0missingmissingmissing
8692Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_102649__55910.0095922.10430[323, 212]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_102649__559.json55.0missingmissingmissing
8693Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_102728__96550.0144238.93464[323, 373]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_102728__965.json100.0missingmissingmissing
8694Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_102808__84630.018539.76014[323, 509]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_102808__846.json90.0missingmissingmissing
8695Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_102849__82010.0155940.24750[323, 412]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_102849__820.json55.0missingmissingmissing
8696Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_102925__44630.0140636.27124[323, 361]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_102925__446.json90.0missingmissingmissing
8697Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_102055__43250.0117122.82214[322, 283]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_102055__432.json100.0missingmissingmissing
8698Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_102142__96150.0176246.99494[322, 480]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_102142__961.json100.0missingmissingmissing
8699Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_102232__59950.0164849.98524[322, 442]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_102232__599.json100.0missingmissingmissing
8700Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_102309__54710.0137236.88560[322, 350]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_102309__547.json55.0missingmissingmissing
8701Apple-MacBook-Pro-M1keep_only_namesgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_102351__76030.0142942.29124[322, 369]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_102351__760.json90.0missingmissingmissing
8702Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewAsIs1SHOTfalsefalse520231213_203437__75200.0076318.23630[61, 234]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_203437__752.json0.0missingmissingmissing
8703Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_194505__94900.006076.475730[61, 182]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_194505__949.json0.0missingmissingmissing
8704Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_194518__37600.0084712.74630[61, 262]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_194518__376.json0.0missingmissingmissing
8705Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_195728__68300.039.33040[61, 390]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_195728__683.json0.00.1missing0.9
8706Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewInJulia1SHOTtruetrue520231213_203418__99150.012144.32894[64, 382]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_203418__991.json100.0missingmissingmissing
8707Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewInJulia1SHOTtruetrue520231225_194446__13150.005959.186094[64, 177]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_194446__131.json100.0missingmissingmissing
8708Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewInJulia1SHOTtruetrue520231225_194458__26030.0079912.51924[64, 245]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_194458__260.json90.0missingmissingmissing
8709Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewInJulia1SHOTtruetrue520231227_202018__14130.0091624.63924[64, 284]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_202018__141.json90.0missingmissingmissing
8710Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewInJulia1SHOTtruetrue520231227_202038__99950.0078119.02374[64, 239]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_202038__999.json100.0missingmissingmissing
8711Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_195649__61950.017.01174[64, 194]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_195649__619.json100.00.1missing0.9
8712Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_203334__74850.003218.502134[99, 74]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_203334__748.json100.0missingmissingmissing
8713Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_194434__69650.003332.944124[99, 78]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_194434__696.json100.0missingmissingmissing
8714Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_194436__38550.002311.799634[99, 44]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_194436__385.json100.0missingmissingmissing
8715Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_201939__42250.001714.449284[99, 24]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_201939__422.json100.0missingmissingmissing
8716Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_201954__20030.0043214.52424[99, 111]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_201954__200.json90.0missingmissingmissing
8717Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_195632__71730.08.371464[99, 90]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_195632__717.json90.00.1missing0.9
8718Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_203325__68230.0098320.41774[173, 270]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203325__682.json90.0missingmissingmissing
8719Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_194419__81930.008158.695444[173, 214]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194419__819.json90.0missingmissingmissing
8720Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_194431__66230.0089311.57484[173, 240]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194431__662.json90.0missingmissingmissing
8721Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_201857__21450.0093518.41364[173, 254]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201857__214.json100.0missingmissingmissing
8722Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_201934__49850.0068337.30494[173, 170]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_201934__498.json100.0missingmissingmissing
8723Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195623__52130.019.52824[173, 234]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195623__521.json90.00.1missing0.9
8724Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_203522__60440.0115120.80774[323, 276]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203522__604.json95.0missingmissingmissing
8725Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_194558__44950.013713.96524[323, 349]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194558__449.json100.0missingmissingmissing
8726Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_194610__81940.009212.2954[323, 199]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194610__819.json95.0missingmissingmissing
8727Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_202133__44630.0109416.09094[323, 257]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202133__446.json90.0missingmissingmissing
8728Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_202143__87430.008249.853094[323, 167]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202143__874.json90.0missingmissingmissing
8729Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_195818__19310.024.11290[323, 333]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195818__193.json55.00.1missing0.9
8730Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_203501__58450.0117723.64564[322, 285]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_203501__584.json100.0missingmissingmissing
8731Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_194528__95210.0083210.77030[322, 170]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_194528__952.json55.0missingmissingmissing
8732Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_194544__41050.0125215.01174[322, 310]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_194544__410.json100.0missingmissingmissing
8733Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_202106__15110.0150128.33640[322, 393]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_202106__151.json55.0missingmissingmissing
8734Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_202117__49510.0091310.94140[322, 197]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_202117__495.json55.0missingmissingmissing
8735Apple-MacBook-Pro-M1keep_only_namesgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_195754__54010.025.91390[322, 304]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_195754__540.json55.00.1missing0.9
8736Apple-MacBook-Pro-M1keep_only_namesllama2AsIs1SHOTfalsefalse520231214_075157__12800.09.200860[52, 279]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__AsIs__1SHOT__20231214_075157__128.json0.0missingmissingmissing
8737Apple-MacBook-Pro-M1keep_only_namesllama2AsIs1SHOTfalsefalse520231225_114000__35300.09.564640[52, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__AsIs__1SHOT__20231225_114000__353.json0.0missing{\n "num_gpu": 99\n}missing
8738Apple-MacBook-Pro-M1keep_only_namesllama2AsIs1SHOTfalsefalse520231225_114010__61200.010.07550[1, 319]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__AsIs__1SHOT__20231225_114010__612.json0.0missing{\n "num_gpu": 99\n}missing
8739Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruetrue520231214_075147__23210.09.140140[69, 271]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231214_075147__232.json55.0missingmissingmissing
8740Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTfalsefalse520231225_113939__28700.011.02090[69, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231225_113939__287.json0.0missing{\n "num_gpu": 99\n}missing
8741Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruetrue520231225_113950__87930.010.80644[1, 341]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231225_113950__879.json90.0missing{\n "num_gpu": 99\n}missing
8742Apple-MacBook-Pro-M1keep_only_namesllama2InJulia1SHOTtruetrue520231227_011538__12500.07.973434[69, 241]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__InJulia__1SHOT__20231227_011538__125.json75.0missing{\n "num_gpu": 99\n}missing
8743Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruetrue520231214_075138__95310.06.774550[98, 190]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_075138__953.json55.0missingmissingmissing
8744Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruetrue520231225_113920__71610.08.377180[98, 241]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_113920__716.json55.0missing{\n "num_gpu": 99\n}missing
8745Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruetrue520231225_113928__56110.07.453680[1, 235]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_113928__561.json55.0missing{\n "num_gpu": 99\n}missing
8746Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertAsk1SHOTtruetrue520231227_011530__23320.07.762254[98, 225]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_011530__233.json85.0missing{\n "num_gpu": 99\n}missing
8747Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231214_075131__32710.011.00890[188, 288]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075131__327.json55.0missingmissingmissing
8748Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231225_113904__17210.020.27610[206, 398]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113904__172.json55.0missing{\n "num_gpu": 99\n}missing
8749Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231225_113912__72610.07.326420[1, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113912__726.json55.0missing{\n "num_gpu": 99\n}missing
8750Apple-MacBook-Pro-M1keep_only_namesllama2JuliaExpertCoTTask1SHOTtruetrue520231227_011522__32010.019.40210[206, 401]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011522__320.json55.0missing{\n "num_gpu": 99\n}missing
8751Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruetrue520231214_075249__86700.030.80580[11, 806]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075249__867.json50.0missingmissingmissing
8752Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruetrue520231225_114107__64800.016.41830[11, 452]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114107__648.json50.0missing{\n "num_gpu": 99\n}missing
8753Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruefalse520231225_114140__67100.032.85060[1, 862]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114140__671.json25.0missing{\n "num_gpu": 99\n}missing
8754Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapCoTTask1SHOTtruetrue520231227_011617__16300.018.31490[11, 506]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011617__163.json50.0missing{\n "num_gpu": 99\n}missing
8755Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTtruefalse520231214_075219__33700.021.9220[369, 512]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_075219__337.json25.0missingmissingmissing
8756Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTfalsefalse520231225_114029__28100.019.28510[369, 447]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_114029__281.json0.0missing{\n "num_gpu": 99\n}missing
8757Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTtruetrue520231225_114050__40720.020.82014[1, 571]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_114050__407.json85.0missing{\n "num_gpu": 99\n}missing
8758Apple-MacBook-Pro-M1keep_only_namesllama2JuliaRecapTask1SHOTtruetrue520231227_011558__69710.020.1394[369, 473]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_011558__697.json80.0missing{\n "num_gpu": 99\n}missing
8759Apple-MacBook-Pro-M1keep_only_namesmagicoderAsIs1SHOTfalsefalse520231214_075934__18200.08.491550[52, 256]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__AsIs__1SHOT__20231214_075934__182.json0.0missingmissingmissing
8760Apple-MacBook-Pro-M1keep_only_namesmagicoderAsIs1SHOTfalsefalse520231225_115621__36300.03.995740[66, 124]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__AsIs__1SHOT__20231225_115621__363.json0.0missing{\n "num_gpu": 99\n}missing
8761Apple-MacBook-Pro-M1keep_only_namesmagicoderAsIs1SHOTfalsefalse520231225_115625__71200.04.171870[66, 131]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__AsIs__1SHOT__20231225_115625__712.json0.0missing{\n "num_gpu": 99\n}missing
8762Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231214_075925__72710.010.79110[69, 322]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231214_075925__727.json55.0missingmissingmissing
8763Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231225_115611__12950.03.870664[69, 120]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231225_115611__129.json100.0missing{\n "num_gpu": 99\n}missing
8764Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231225_115617__69950.05.76484[69, 186]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231225_115617__699.json100.0missing{\n "num_gpu": 99\n}missing
8765Apple-MacBook-Pro-M1keep_only_namesmagicoderInJulia1SHOTtruetrue520231227_012301__54550.07.673754[69, 249]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__InJulia__1SHOT__20231227_012301__545.json100.0missing{\n "num_gpu": 99\n}missing
8766Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231214_075914__60910.08.579430[98, 246]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_075914__609.json55.0missingmissingmissing
8767Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231225_115559__49310.07.707620[108, 247]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_115559__493.json55.0missing{\n "num_gpu": 99\n}missing
8768Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231225_115607__81450.07.120724[108, 225]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_115607__814.json100.0missing{\n "num_gpu": 99\n}missing
8769Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertAsk1SHOTtruetrue520231227_012253__53550.06.415644[108, 201]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_012253__535.json100.0missing{\n "num_gpu": 99\n}missing
8770Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_075906__37300.014.16370[188, 380]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075906__373.json0.0missingmissingmissing
8771Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_115545__75510.012.97544[198, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115545__755.json80.0missing{\n "num_gpu": 99\n}missing
8772Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_115552__21450.06.039384[198, 174]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115552__214.json100.0missing{\n "num_gpu": 99\n}missing
8773Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_012247__40850.012.50724[198, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012247__408.json100.0missing{\n "num_gpu": 99\n}missing
8774Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_080019__90910.017.88864[11, 488]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080019__909.json80.0missingmissingmissing
8775Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_115644__64550.06.421664[372, 159]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115644__645.json100.0missing{\n "num_gpu": 99\n}missing
8776Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_115657__68310.013.05120[372, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115657__683.json55.0missing{\n "num_gpu": 99\n}missing
8777Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_012318__32200.08.257770[372, 218]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012318__322.json50.0missing{\n "num_gpu": 99\n}missing
8778Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231214_080001__64400.027.67340[369, 656]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_080001__644.json50.0missingmissingmissing
8779Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231225_115632__59950.06.902014[369, 175]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_115632__599.json100.0missing{\n "num_gpu": 99\n}missing
8780Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231225_115638__21430.05.042924[369, 114]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_115638__214.json90.0missing{\n "num_gpu": 99\n}missing
8781Apple-MacBook-Pro-M1keep_only_namesmagicoderJuliaRecapTask1SHOTtruetrue520231227_012310__65050.08.132644[369, 214]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_012310__650.json100.0missing{\n "num_gpu": 99\n}missing
8782Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181743__63950.011.3314[69, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181743__639.json100.0missing{\n "num_gpu": 99\n}missing
8783Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181755__85950.011.61284[69, 208]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181755__859.json100.0missing{\n "num_gpu": 99\n}missing
8784Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_181805__87850.010.01434[69, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_181805__878.json100.0missing{\n "num_gpu": 99\n}missing
8785Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181716__58110.012.45164[108, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181716__581.json80.0missing{\n "num_gpu": 99\n}missing
8786Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181725__97050.08.438324[108, 145]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181725__970.json100.0missing{\n "num_gpu": 99\n}missing
8787Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_181732__78910.06.94840[108, 119]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_181732__789.json55.0missing{\n "num_gpu": 99\n}missing
8788Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181641__91350.011.75274[198, 192]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181641__913.json100.0missing{\n "num_gpu": 99\n}missing
8789Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181651__52650.010.1844[198, 170]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181651__526.json100.0missing{\n "num_gpu": 99\n}missing
8790Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_181703__90250.012.12884[198, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181703__902.json100.0missing{\n "num_gpu": 99\n}missing
8791Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181856__90050.014.53294[372, 238]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181856__900.json100.0missing{\n "num_gpu": 99\n}missing
8792Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181905__26610.08.941610[372, 133]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181905__266.json55.0missing{\n "num_gpu": 99\n}missing
8793Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_181914__95110.08.044170[372, 116]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_181914__951.json55.0missing{\n "num_gpu": 99\n}missing
8794Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181818__68810.012.45530[369, 203]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181818__688.json55.0missing{\n "num_gpu": 99\n}missing
8795Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181832__40100.014.26930[369, 228]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181832__401.json50.0missing{\n "num_gpu": 99\n}missing
8796Apple-MacBook-Pro-M1keep_only_namesmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_181842__77050.09.194144[369, 133]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_181842__770.json100.0missing{\n "num_gpu": 99\n}missing
8797Apple-MacBook-Pro-M1keep_only_namesmistral-mediumAsIs1SHOTfalsefalse520231213_203639__96200.001604734.000340[64, 177]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__AsIs__1SHOT__20231213_203639__962.json0.0missingmissingmissing
8798Apple-MacBook-Pro-M1keep_only_namesmistral-mediumAsIs1SHOTfalsefalse520231225_194846__64200.004217811.13420[64, 500]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__AsIs__1SHOT__20231225_194846__642.json0.0missingmissingmissing
8799Apple-MacBook-Pro-M1keep_only_namesmistral-mediumAsIs1SHOTfalsefalse520231225_194851__90600.00195264.910170[64, 220]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__AsIs__1SHOT__20231225_194851__906.json0.0missingmissingmissing
8800Apple-MacBook-Pro-M1keep_only_namesmistral-medium--optimAsIs1SHOTfalsefalse520231215_195956__87000.016.99030[64, 217]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__AsIs__1SHOT__20231215_195956__870.json0.00.9missing0.3
8801Apple-MacBook-Pro-M1keep_only_namesmistral-mediumInJulia1SHOTtruetrue520231213_203635__11950.003473539.10964[67, 407]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__InJulia__1SHOT__20231213_203635__119.json100.0missingmissingmissing
8802Apple-MacBook-Pro-M1keep_only_namesmistral-mediumInJulia1SHOTtruetrue520231225_194828__90910.001661374.173030[67, 183]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__InJulia__1SHOT__20231225_194828__909.json55.0missingmissingmissing
8803Apple-MacBook-Pro-M1keep_only_namesmistral-mediumInJulia1SHOTtruetrue520231225_194835__58640.002777797.169994[67, 321]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__InJulia__1SHOT__20231225_194835__586.json95.0missingmissingmissing
8804Apple-MacBook-Pro-M1keep_only_namesmistral-mediumInJulia1SHOTtruetrue520231227_202332__29410.002583636.647180[67, 297]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__InJulia__1SHOT__20231227_202332__294.json55.0missingmissingmissing
8805Apple-MacBook-Pro-M1keep_only_namesmistral-mediumInJulia1SHOTtruetrue520231227_202343__53050.0040317410.62834[67, 476]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__InJulia__1SHOT__20231227_202343__530.json100.0missingmissingmissing
8806Apple-MacBook-Pro-M1keep_only_namesmistral-medium--optimInJulia1SHOTtruetrue520231215_195939__97350.022.30354[67, 396]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__InJulia__1SHOT__20231215_195939__973.json100.00.9missing0.3
8807Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_203625__60210.001378354.547270[106, 135]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_203625__602.json55.0missingmissingmissing
8808Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_194820__72710.002276345.510220[106, 246]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_194820__727.json55.0missingmissingmissing
8809Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_194823__12450.001434983.246274[106, 142]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_194823__124.json100.0missingmissingmissing
8810Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_202321__71410.002114545.282370[106, 226]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_202321__714.json55.0missingmissingmissing
8811Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_202325__98250.001596783.684484[106, 162]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_202325__982.json100.0missingmissingmissing
8812Apple-MacBook-Pro-M1keep_only_namesmistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_195916__79710.03.215710[106, 145]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_195916__797.json55.00.9missing0.3
8813Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_203621__86850.0016941611.06474[196, 144]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203621__868.json100.0missingmissingmissing
8814Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_194808__98710.003668128.756360[196, 388]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194808__987.json55.0missingmissingmissing
8815Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_194814__87510.002592155.739490[196, 255]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194814__875.json55.0missingmissingmissing
8816Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_202309__41050.0048411712.06934[196, 533]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202309__410.json100.0missingmissingmissing
8817Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_202316__86010.002996656.9820[196, 305]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202316__860.json55.0missingmissingmissing
8818Apple-MacBook-Pro-M1keep_only_namesmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195913__56110.08.228190[196, 373]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195913__561.json55.00.9missing0.3
8819Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_203723__56640.0043617432.60674[369, 416]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203723__566.json95.0missingmissingmissing
8820Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_194952__19500.0044911816.88760[369, 432]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194952__195.json50.0missingmissingmissing
8821Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_195006__31000.0040381414.00670[369, 376]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_195006__310.json50.0missingmissingmissing
8822Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapCoTTask1SHOTfalsefalse520231227_202419__36100.0027194710.33220[369, 213]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202419__361.json0.0missingmissingmissing
8823Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_202447__27610.0045478127.28270[369, 439]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202447__276.json55.0missingmissingmissing
8824Apple-MacBook-Pro-M1keep_only_namesmistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_200218__70640.022.12824[369, 466]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_200218__706.json95.00.9missing0.3
8825Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapTask1SHOTtruefalse520231213_203650__73800.0050817411.56570[366, 506]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_203650__738.json25.0missingmissingmissing
8826Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapTask1SHOTtruetrue520231225_194901__67140.0045882510.09664[366, 445]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_194901__671.json95.0missingmissingmissing
8827Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapTask1SHOTtruetrue520231225_194935__26500.0080426833.30910[366, 872]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_194935__265.json50.0missingmissingmissing
8828Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapTask1SHOTtruetrue520231227_202351__11600.003795438.469750[366, 347]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_202351__116.json50.0missingmissingmissing
8829Apple-MacBook-Pro-M1keep_only_namesmistral-mediumJuliaRecapTask1SHOTtruetrue520231227_202409__66200.0050493817.50840[366, 502]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_202409__662.json50.0missingmissingmissing
8830Apple-MacBook-Pro-M1keep_only_namesmistral-smallAsIs1SHOTfalsefalse520231213_203602__75300.0002224751.418710[65, 93]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__AsIs__1SHOT__20231213_203602__753.json0.0missingmissingmissing
8831Apple-MacBook-Pro-M1keep_only_namesmistral-smallAsIs1SHOTfalsefalse520231225_194726__19600.0002748551.816090[65, 120]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__AsIs__1SHOT__20231225_194726__196.json0.0missingmissingmissing
8832Apple-MacBook-Pro-M1keep_only_namesmistral-smallAsIs1SHOTfalsefalse520231225_194728__49800.0003175352.452310[65, 142]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__AsIs__1SHOT__20231225_194728__498.json0.0missingmissingmissing
8833Apple-MacBook-Pro-M1keep_only_namesmistral-small--optimAsIs1SHOTfalsefalse520231215_195850__22800.01.390420[65, 93]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__AsIs__1SHOT__20231215_195850__228.json0.00.9missing0.3
8834Apple-MacBook-Pro-M1keep_only_namesmistral-smallInJulia1SHOTtruetrue520231213_203601__34310.0004300562.765820[68, 199]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__InJulia__1SHOT__20231213_203601__343.json55.0missingmissingmissing
8835Apple-MacBook-Pro-M1keep_only_namesmistral-smallInJulia1SHOTtruetrue520231225_194717__21950.00068419612.64364[68, 330]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__InJulia__1SHOT__20231225_194717__219.json100.0missingmissingmissing
8836Apple-MacBook-Pro-M1keep_only_namesmistral-smallInJulia1SHOTtruetrue520231225_194724__33550.0008956566.43464[68, 439]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__InJulia__1SHOT__20231225_194724__335.json100.0missingmissingmissing
8837Apple-MacBook-Pro-M1keep_only_namesmistral-smallInJulia1SHOTtruetrue520231227_202232__69310.0005580963.589940[68, 265]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__InJulia__1SHOT__20231227_202232__693.json55.0missingmissingmissing
8838Apple-MacBook-Pro-M1keep_only_namesmistral-smallInJulia1SHOTtruetrue520231227_202235__47310.0003660362.709890[68, 166]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__InJulia__1SHOT__20231227_202235__473.json55.0missingmissingmissing
8839Apple-MacBook-Pro-M1keep_only_namesmistral-small--optimInJulia1SHOTtruetrue520231215_195848__96010.04.246160[68, 316]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__InJulia__1SHOT__20231215_195848__960.json55.00.9missing0.3
8840Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertAsk1SHOTtruetrue520231213_203558__19150.0005962633.696054[109, 271]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_203558__191.json100.0missingmissingmissing
8841Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_194700__40420.0007320634.651644[109, 341]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_194700__404.json85.0missingmissingmissing
8842Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertAsk1SHOTtruetrue520231225_194704__77110.0006777434.262250[109, 313]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_194704__771.json55.0missingmissingmissing
8843Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertAsk1SHOTtruetrue520231227_202223__18100.0003537632.292160[109, 146]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_202223__181.json50.0missingmissingmissing
8844Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertAsk1SHOTtruetrue520231227_202229__56150.0009066635.753674[109, 431]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_202229__561.json100.0missingmissingmissing
8845Apple-MacBook-Pro-M1keep_only_namesmistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_195844__32650.03.653114[109, 275]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_195844__326.json100.00.9missing0.3
8846Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_203554__88150.0006021133.334344[199, 244]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203554__881.json100.0missingmissingmissing
8847Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_194649__52950.0005885333.31114[199, 237]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194649__529.json100.0missingmissingmissing
8848Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_194655__61410.0008834135.287580[199, 389]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194655__614.json55.0missingmissingmissing
8849Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_202216__71350.0005497333.583614[199, 217]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202216__713.json100.0missingmissingmissing
8850Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_202220__32650.0007359734.286954[199, 313]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202220__326.json100.0missingmissingmissing
8851Apple-MacBook-Pro-M1keep_only_namesmistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195840__81350.04.510714[199, 335]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195840__813.json100.00.9missing0.3
8852Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_203609__73310.0007315053.451684[375, 252]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203609__733.json80.0missingmissingmissing
8853Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_194741__39150.0009643055.165454[375, 372]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194741__391.json100.0missingmissingmissing
8854Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_194759__99850.00091968517.96244[375, 349]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194759__998.json100.0missingmissingmissing
8855Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_202250__50150.001338737.581544[375, 565]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202250__501.json100.0missingmissingmissing
8856Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_202257__80110.001092346.061120[375, 438]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202257__801.json55.0missingmissingmissing
8857Apple-MacBook-Pro-M1keep_only_namesmistral-small--optimJuliaRecapCoTTask1SHOTtruetrue520231215_195904__96350.08.72324[375, 654]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195904__963.json100.00.9missing0.3
8858Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapTask1SHOTtruetrue520231213_203606__25910.0007146913.384370[373, 244]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_203606__259.json55.0missingmissingmissing
8859Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapTask1SHOTtruetrue520231225_194732__70210.0007399113.51240[373, 257]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_194732__702.json55.0missingmissingmissing
8860Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapTask1SHOTtruetrue520231225_194735__66010.0007360313.598530[373, 255]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_194735__660.json55.0missingmissingmissing
8861Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapTask1SHOTtruetrue520231227_202239__38200.0006991713.317030[373, 236]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_202239__382.json50.0missingmissingmissing
8862Apple-MacBook-Pro-M1keep_only_namesmistral-smallJuliaRecapTask1SHOTtruetrue520231227_202242__59310.0007651313.761780[373, 270]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_202242__593.json55.0missingmissingmissing
8863Apple-MacBook-Pro-M1keep_only_namesmistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_195856__63750.05.657714[373, 424]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_195856__637.json100.00.9missing0.3
8864Apple-MacBook-Pro-M1keep_only_namesmistral-tinyAsIs1SHOTfalsefalse520231213_203540__49900.0001074012.337940[65, 217]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__AsIs__1SHOT__20231213_203540__499.json0.0missingmissingmissing
8865Apple-MacBook-Pro-M1keep_only_namesmistral-tinyAsIs1SHOTfalsefalse520231225_194632__78600.0001735393.204030[65, 363]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__AsIs__1SHOT__20231225_194632__786.json0.0missingmissingmissing
8866Apple-MacBook-Pro-M1keep_only_namesmistral-tinyAsIs1SHOTfalsefalse520231225_194635__39800.000122352.205530[65, 250]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__AsIs__1SHOT__20231225_194635__398.json0.0missingmissingmissing
8867Apple-MacBook-Pro-M1keep_only_namesmistral-tiny--optimAsIs1SHOTfalsefalse520231215_195829__14900.01.999150[65, 234]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__AsIs__1SHOT__20231215_195829__149.json0.00.9missing0.3
8868Apple-MacBook-Pro-M1keep_only_namesmistral-tinyInJulia1SHOTtruetrue520231213_203538__75700.0002256017.732510[68, 477]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__InJulia__1SHOT__20231213_203538__757.json50.0missingmissingmissing
8869Apple-MacBook-Pro-M1keep_only_namesmistral-tinyInJulia1SHOTtruetrue520231225_194625__79130.0001023851.849424[68, 205]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__InJulia__1SHOT__20231225_194625__791.json90.0missingmissingmissing
8870Apple-MacBook-Pro-M1keep_only_namesmistral-tinyInJulia1SHOTtruetrue520231225_194629__20000.0001784893.295834[68, 373]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__InJulia__1SHOT__20231225_194629__200.json75.0missingmissingmissing
8871Apple-MacBook-Pro-M1keep_only_namesmistral-tinyInJulia1SHOTtruetrue520231227_202159__84900.0001263942.641790[68, 258]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__InJulia__1SHOT__20231227_202159__849.json50.0missingmissingmissing
8872Apple-MacBook-Pro-M1keep_only_namesmistral-tiny--optimInJulia1SHOTtruetrue520231215_195827__12000.01.887420[68, 222]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__InJulia__1SHOT__20231215_195827__120.json50.00.9missing0.3
8873Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_203530__18703.6098e-50.9172320[109, 46]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_203530__187.json50.0missingmissingmissing
8874Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_194622__70709.4535e-51.597560[109, 175]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_194622__707.json50.0missingmissingmissing
8875Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_194623__48307.1432e-51.167020[109, 124]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_194623__483.json50.0missingmissingmissing
8876Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_202155__38004.697e-50.8074434[109, 70]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_202155__380.json75.0missingmissingmissing
8877Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_202156__47803.6551e-50.6045390[109, 47]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_202156__478.json50.0missingmissingmissing
8878Apple-MacBook-Pro-M1keep_only_namesmistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_195825__21000.00.5830830[109, 46]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_195825__210.json50.00.9missing0.3
8879Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231213_203529__49000.0001651196.995510[199, 303]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203529__490.json50.0missingmissingmissing
8880Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_194618__85800.000163767.406390[199, 300]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194618__858.json0.0missingmissingmissing
8881Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_194621__50900.0001596832.655670[199, 291]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_194621__509.json0.0missingmissingmissing
8882Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_202152__21810.0001433758.386044[199, 255]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202152__218.json80.0missingmissingmissing
8883Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_202154__67700.0001528882.50690[199, 276]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202154__677.json50.0missingmissingmissing
8884Apple-MacBook-Pro-M1keep_only_namesmistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_195824__84200.05.968710[199, 268]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_195824__842.json50.00.9missing0.3
8885Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_203551__80200.0002047084.688170[375, 336]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203551__802.json50.0missingmissingmissing
8886Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_194644__93900.0001444592.054380[375, 203]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194644__939.json50.0missingmissingmissing
8887Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_194646__88110.0001643912.232690[375, 247]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_194646__881.json55.0missingmissingmissing
8888Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_202208__88500.0002078793.169960[375, 343]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202208__885.json50.0missingmissingmissing
8889Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_202212__34300.0002540853.984090[375, 445]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202212__343.json50.0missingmissingmissing
8890Apple-MacBook-Pro-M1keep_only_namesmistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_195836__88200.02.545440[375, 303]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_195836__882.json50.00.9missing0.3
8891Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapTask1SHOTtruetrue520231213_203546__25600.0001908385.628530[373, 306]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_203546__256.json50.0missingmissingmissing
8892Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapTask1SHOTtruetrue520231225_194638__26700.00021533.322230[373, 360]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_194638__267.json50.0missingmissingmissing
8893Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapTask1SHOTtruetrue520231225_194641__65200.0002239073.489820[373, 379]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_194641__652.json50.0missingmissingmissing
8894Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapTask1SHOTtruetrue520231227_202202__21100.0001953682.831580[373, 316]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_202202__211.json50.0missingmissingmissing
8895Apple-MacBook-Pro-M1keep_only_namesmistral-tinyJuliaRecapTask1SHOTtruetrue520231227_202205__50400.0002085053.081210[373, 345]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_202205__504.json50.0missingmissingmissing
8896Apple-MacBook-Pro-M1keep_only_namesmistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_195833__91500.03.724720[373, 438]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_195833__915.json50.00.9missing0.3
8897Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_121859__81800.08.353790[64, 211]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_121859__818.json0.0missing{\n "num_gpu": 99\n}missing
8898Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_121905__91700.06.060670[64, 151]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_121905__917.json0.0missing{\n "num_gpu": 99\n}missing
8899Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121844__83600.05.889660[67, 143]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121844__836.json50.0missing{\n "num_gpu": 99\n}missing
8900Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_121851__25430.06.245074[67, 152]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_121851__254.json90.0missing{\n "num_gpu": 99\n}missing
8901Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_013322__87830.05.855274[67, 141]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_013322__878.json90.0missing{\n "num_gpu": 99\n}missing
8902Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121836__45910.02.033870[108, 36]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121836__459.json55.0missing{\n "num_gpu": 99\n}missing
8903Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121838__24400.02.007730[108, 35]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121838__244.json50.0missing{\n "num_gpu": 99\n}missing
8904Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_013316__55630.02.383884[108, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_013316__556.json90.0missing{\n "num_gpu": 99\n}missing
8905Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_121827__74610.015.79630[198, 236]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121827__746.json55.0missing{\n "num_gpu": 99\n}missing
8906Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_121834__22600.07.050530[198, 154]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121834__226.json0.0missing{\n "num_gpu": 99\n}missing
8907Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_013313__28330.017.91744[198, 294]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013313__283.json90.0missing{\n "num_gpu": 99\n}missing
8908Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121940__50610.016.04120[375, 356]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121940__506.json55.0missing{\n "num_gpu": 99\n}missing
8909Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_121954__68100.014.04190[375, 306]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121954__681.json25.0missing{\n "num_gpu": 99\n}missing
8910Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013346__97600.013.34960[375, 287]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013346__976.json50.0missing{\n "num_gpu": 99\n}missing
8911Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121916__98010.010.76370[373, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121916__980.json55.0missing{\n "num_gpu": 99\n}missing
8912Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121923__60510.07.279390[373, 136]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121923__605.json55.0missing{\n "num_gpu": 99\n}missing
8913Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013333__65300.010.4210[373, 214]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013333__653.json50.0missing{\n "num_gpu": 99\n}missing
8914Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_000117__74900.06.720734[66, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000117__749.json75.0missing{\n "num_gpu": 99\n}missing
8915Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_000125__87000.07.919290[66, 248]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000125__870.json50.0missing{\n "num_gpu": 99\n}missing
8916Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_000138__57800.012.62770[66, 401]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000138__578.json0.0missing{\n "num_gpu": 99\n}missing
8917Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_000147__26500.08.945190[66, 282]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000147__265.json0.0missing{\n "num_gpu": 99\n}missing
8918Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_000156__78200.09.098510[66, 287]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_000156__782.json0.0missing{\n "num_gpu": 99\n}missing
8919Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_000100__93610.01.838670[107, 41]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000100__936.json55.0missing{\n "num_gpu": 99\n}missing
8920Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_000105__21610.04.18420[107, 120]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000105__216.json55.0missing{\n "num_gpu": 99\n}missing
8921Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_000107__49400.01.79230[107, 40]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000107__494.json0.0missing{\n "num_gpu": 99\n}missing
8922Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_000108__36100.01.81990[107, 41]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000108__361.json0.0missing{\n "num_gpu": 99\n}missing
8923Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_000110__10600.01.981610[107, 46]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_000110__106.json50.0missing{\n "num_gpu": 99\n}missing
8924Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_000018__11100.012.72390[197, 355]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000018__111.json0.0missing{\n "num_gpu": 99\n}missing
8925Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_000029__68900.010.68990[197, 315]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000029__689.json0.0missing{\n "num_gpu": 99\n}missing
8926Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_000040__69500.011.10024[197, 324]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000040__695.json75.0missing{\n "num_gpu": 99\n}missing
8927Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_000050__24600.010.0160[197, 293]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000050__246.json50.0missing{\n "num_gpu": 99\n}missing
8928Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_000058__41500.08.467030[197, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000058__415.json0.0missing{\n "num_gpu": 99\n}missing
8929Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000305__61320.08.053534[374, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000305__613.json85.0missing{\n "num_gpu": 99\n}missing
8930Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000317__98500.011.48260[374, 309]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000317__985.json50.0missing{\n "num_gpu": 99\n}missing
8931Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000327__41710.010.44180[374, 277]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000327__417.json55.0missing{\n "num_gpu": 99\n}missing
8932Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_000337__84900.09.67490[374, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000337__849.json0.0missing{\n "num_gpu": 99\n}missing
8933Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_000351__91000.014.17060[374, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000351__910.json50.0missing{\n "num_gpu": 99\n}missing
8934Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000206__87500.09.841950[372, 258]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000206__875.json50.0missing{\n "num_gpu": 99\n}missing
8935Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000221__87040.015.39974[372, 429]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000221__870.json95.0missing{\n "num_gpu": 99\n}missing
8936Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000236__78300.014.06830[372, 389]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000236__783.json50.0missing{\n "num_gpu": 99\n}missing
8937Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231228_000246__33500.010.66770[372, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000246__335.json0.0missing{\n "num_gpu": 99\n}missing
8938Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_000257__56000.010.57360[372, 280]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_000257__560.json50.0missing{\n "num_gpu": 99\n}missing
8939Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000536__99900.08.16740[66, 200]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000536__999.json50.0missing{\n "num_gpu": 99\n}missing
8940Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_000544__68300.07.376350[66, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000544__683.json0.0missing{\n "num_gpu": 99\n}missing
8941Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000553__10800.09.614190[66, 238]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000553__108.json50.0missing{\n "num_gpu": 99\n}missing
8942Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000603__75900.09.357210[66, 231]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000603__759.json50.0missing{\n "num_gpu": 99\n}missing
8943Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_000611__70300.08.122830[66, 199]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_000611__703.json50.0missing{\n "num_gpu": 99\n}missing
8944Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000514__10800.03.091530[107, 63]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000514__108.json50.0missing{\n "num_gpu": 99\n}missing
8945Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000519__44110.04.959160[107, 112]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000519__441.json55.0missing{\n "num_gpu": 99\n}missing
8946Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000522__62800.02.980890[107, 60]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000522__628.json50.0missing{\n "num_gpu": 99\n}missing
8947Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000525__17400.02.936680[107, 59]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000525__174.json50.0missing{\n "num_gpu": 99\n}missing
8948Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_000528__32500.03.012480[107, 61]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_000528__325.json50.0missing{\n "num_gpu": 99\n}missing
8949Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_000404__56200.012.89390[197, 280]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000404__562.json50.0missing{\n "num_gpu": 99\n}missing
8950Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_000422__47110.018.13390[197, 432]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000422__471.json55.0missing{\n "num_gpu": 99\n}missing
8951Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_000439__62700.016.40790[197, 389]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000439__627.json0.0missing{\n "num_gpu": 99\n}missing
8952Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_000452__10900.012.88660[197, 301]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000452__109.json0.0missing{\n "num_gpu": 99\n}missing
8953Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_000510__18530.018.68994[197, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000510__185.json90.0missing{\n "num_gpu": 99\n}missing
8954Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000729__36800.011.26890[374, 234]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000729__368.json50.0missing{\n "num_gpu": 99\n}missing
8955Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000759__73010.029.96570[374, 687]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000759__730.json55.0missing{\n "num_gpu": 99\n}missing
8956Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000815__48100.015.88550[374, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000815__481.json50.0missing{\n "num_gpu": 99\n}missing
8957Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231228_000827__77900.011.86080[374, 249]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000827__779.json0.0missing{\n "num_gpu": 99\n}missing
8958Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_000841__81600.013.77850[374, 296]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_000841__816.json50.0missing{\n "num_gpu": 99\n}missing
8959Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000625__82200.013.57430[372, 291]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000625__822.json50.0missing{\n "num_gpu": 99\n}missing
8960Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000640__28800.015.18640[372, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000640__288.json50.0missing{\n "num_gpu": 99\n}missing
8961Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000654__86300.014.21430[372, 307]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000654__863.json50.0missing{\n "num_gpu": 99\n}missing
8962Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000704__98100.09.81810[372, 198]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000704__981.json50.0missing{\n "num_gpu": 99\n}missing
8963Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_000718__52610.013.59640[372, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_000718__526.json55.0missing{\n "num_gpu": 99\n}missing
8964Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_122814__54000.016.47380[63, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_122814__540.json0.0missing{\n "num_gpu": 99\n}missing
8965Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_122826__78500.011.98780[63, 221]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_122826__785.json0.0missing{\n "num_gpu": 99\n}missing
8966Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_122745__87000.013.62630[66, 249]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122745__870.json50.0missing{\n "num_gpu": 99\n}missing
8967Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_122758__36300.013.15370[66, 240]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_122758__363.json0.0missing{\n "num_gpu": 99\n}missing
8968Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231227_013550__30100.013.06020[66, 238]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_013550__301.json0.0missing{\n "num_gpu": 99\n}missing
8969Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_122728__71400.03.13030[107, 46]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122728__714.json50.0missing{\n "num_gpu": 99\n}missing
8970Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_122731__65800.03.015690[107, 44]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_122731__658.json50.0missing{\n "num_gpu": 99\n}missing
8971Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_013537__27600.07.869990[107, 136]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_013537__276.json50.0missing{\n "num_gpu": 99\n}missing
8972Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122701__73210.011.60194[197, 196]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122701__732.json80.0missing{\n "num_gpu": 99\n}missing
8973Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_122724__19410.023.52794[197, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_122724__194.json80.0missing{\n "num_gpu": 99\n}missing
8974Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_013529__73630.031.21664[197, 397]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013529__736.json90.0missing{\n "num_gpu": 99\n}missing
8975Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122922__42600.019.92790[374, 330]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122922__426.json50.0missing{\n "num_gpu": 99\n}missing
8976Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_122941__99200.018.67260[374, 307]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_122941__992.json50.0missing{\n "num_gpu": 99\n}missing
8977Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_013632__72610.019.76444[374, 326]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013632__726.json80.0missing{\n "num_gpu": 99\n}missing
8978Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122845__71500.018.89850[372, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122845__715.json50.0missing{\n "num_gpu": 99\n}missing
8979Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_122902__30600.016.91560[372, 275]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_122902__306.json50.0missing{\n "num_gpu": 99\n}missing
8980Apple-MacBook-Pro-M1keep_only_namesmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231227_013612__58400.022.18350[372, 370]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_013612__584.json50.0missing{\n "num_gpu": 99\n}missing
8981Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_122745__85710.058.88550[71, 344]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_122745__857.json55.0missing{\n "num_gpu": 99\n}missing
8982Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_122826__42750.040.54834[71, 237]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_122826__427.json100.0missing{\n "num_gpu": 99\n}missing
8983Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_122849__31800.022.52820[71, 126]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_122849__318.json50.0missing{\n "num_gpu": 99\n}missing
8984Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_153501__74350.050.29374[71, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_153501__743.json100.0missing{\n "num_gpu": 99\n}missing
8985Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_153539__35910.037.51140[71, 205]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_153539__359.json55.0missing{\n "num_gpu": 99\n}missing
8986Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_122614__44600.012.18890[110, 53]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_122614__446.json0.0missing{\n "num_gpu": 99\n}missing
8987Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_122630__10300.016.7780[110, 80]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_122630__103.json0.0missing{\n "num_gpu": 99\n}missing
8988Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_122646__38000.016.19730[110, 74]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_122646__380.json0.0missing{\n "num_gpu": 99\n}missing
8989Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_153343__11100.09.550220[110, 40]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_153343__111.json0.0missing{\n "num_gpu": 99\n}missing
8990Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_153410__84550.027.2174[110, 149]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_153410__845.json100.0missing{\n "num_gpu": 99\n}missing
8991Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_122353__26800.064.74920[200, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122353__268.json0.0missing{\n "num_gpu": 99\n}missing
8992Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_122441__80900.048.14430[200, 244]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122441__809.json0.0missing{\n "num_gpu": 99\n}missing
8993Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_122601__39750.079.72524[200, 419]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_122601__397.json100.0missing{\n "num_gpu": 99\n}missing
8994Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_153234__75010.055.62980[200, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_153234__750.json55.0missing{\n "num_gpu": 99\n}missing
8995Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_153333__89300.059.52870[200, 328]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_153333__893.json50.0missing{\n "num_gpu": 99\n}missing
8996Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_123146__80400.034.65430[384, 151]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123146__804.json0.0missing{\n "num_gpu": 99\n}missing
8997Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_123156__10900.010.24730[384, 4]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123156__109.json0.0missing{\n "num_gpu": 99\n}missing
8998Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_123326__21850.090.1094[384, 477]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123326__218.json100.0missing{\n "num_gpu": 99\n}missing
8999Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_153751__29700.010.4330[384, 4]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153751__297.json0.0missing{\n "num_gpu": 99\n}missing
9000Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_153824__97100.033.20010[384, 141]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_153824__971.json0.0missing{\n "num_gpu": 99\n}missing
9001Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_122951__97630.061.79024[382, 312]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_122951__976.json90.0missing{\n "num_gpu": 99\n}missing
9002Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_123037__57510.045.72930[382, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_123037__575.json55.0missing{\n "num_gpu": 99\n}missing
9003Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_123111__66250.034.29414[382, 149]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_123111__662.json100.0missing{\n "num_gpu": 99\n}missing
9004Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_153612__39310.032.78570[382, 138]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_153612__393.json55.0missing{\n "num_gpu": 99\n}missing
9005Apple-MacBook-Pro-M1keep_only_namesnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_153740__68210.088.09050[382, 457]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_153740__682.json55.0missing{\n "num_gpu": 99\n}missing
9006Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_122053__94100.08.02770[72, 198]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_122053__941.json0.0missing{\n "num_gpu": 99\n}missing
9007Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_122058__20200.04.74150[72, 112]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_122058__202.json0.0missing{\n "num_gpu": 99\n}missing
9008Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_122038__54130.06.537784[75, 159]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_122038__541.json90.0missing{\n "num_gpu": 99\n}missing
9009Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_122045__59300.07.103824[75, 174]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_122045__593.json75.0missing{\n "num_gpu": 99\n}missing
9010Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_013414__23800.06.641980[75, 161]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_013414__238.json50.0missing{\n "num_gpu": 99\n}missing
9011Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_122029__21000.04.773290[116, 108]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_122029__210.json50.0missing{\n "num_gpu": 99\n}missing
9012Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_122031__69410.02.352630[116, 44]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_122031__694.json55.0missing{\n "num_gpu": 99\n}missing
9013Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_013407__59930.03.685044[116, 79]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_013407__599.json90.0missing{\n "num_gpu": 99\n}missing
9014Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_122015__57400.020.80950[206, 343]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122015__574.json50.0missing{\n "num_gpu": 99\n}missing
9015Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_122024__65410.09.137780[206, 207]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122024__654.json55.0missing{\n "num_gpu": 99\n}missing
9016Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_013403__53500.017.30260[206, 263]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013403__535.json25.0missing{\n "num_gpu": 99\n}missing
9017Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_122134__14010.011.62930[383, 245]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122134__140.json55.0missing{\n "num_gpu": 99\n}missing
9018Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_122147__30410.011.99150[383, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122147__304.json55.0missing{\n "num_gpu": 99\n}missing
9019Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013443__36910.014.18490[383, 307]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013443__369.json55.0missing{\n "num_gpu": 99\n}missing
9020Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_122111__95650.013.01214[381, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_122111__956.json100.0missing{\n "num_gpu": 99\n}missing
9021Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_122123__29200.011.82150[381, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_122123__292.json0.0missing{\n "num_gpu": 99\n}missing
9022Apple-MacBook-Pro-M1keep_only_namesopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013429__39810.014.78920[381, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013429__398.json55.0missing{\n "num_gpu": 99\n}missing
9023Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_075333__27100.09.724090[52, 296]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_075333__271.json0.0missingmissingmissing
9024Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_114232__68500.04.938460[70, 154]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_114232__685.json0.0missing{\n "num_gpu": 99\n}missing
9025Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_114238__55800.06.052940[70, 191]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_114238__558.json0.0missing{\n "num_gpu": 99\n}missing
9026Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTfalsefalse520231214_075323__88300.012.05690[69, 359]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_075323__883.json0.0missingmissingmissing
9027Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_114216__26950.05.599874[73, 176]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_114216__269.json100.0missing{\n "num_gpu": 99\n}missing
9028Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_114227__70610.011.47620[73, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_114227__706.json55.0missing{\n "num_gpu": 99\n}missing
9029Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralInJulia1SHOTtruetrue520231227_011645__52350.08.737984[73, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_011645__523.json100.0missing{\n "num_gpu": 99\n}missing
9030Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_075311__71710.08.98480[98, 258]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_075311__717.json55.0missingmissingmissing
9031Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231225_114205__23900.02.55450[114, 67]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_114205__239.json0.0missing{\n "num_gpu": 99\n}missing
9032Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_114210__65750.05.195154[114, 157]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_114210__657.json100.0missing{\n "num_gpu": 99\n}missing
9033Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_011636__19450.04.220624[114, 123]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_011636__194.json100.0missing{\n "num_gpu": 99\n}missing
9034Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231214_075302__12500.012.40730[188, 331]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075302__125.json25.0missingmissingmissing
9035Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_114155__85440.015.04084[204, 288]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114155__854.json95.0missing{\n "num_gpu": 99\n}missing
9036Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_114202__91730.07.196314[204, 208]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114202__917.json90.0missing{\n "num_gpu": 99\n}missing
9037Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_011631__17650.014.60134[204, 286]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011631__176.json100.0missing{\n "num_gpu": 99\n}missing
9038Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231214_075409__68000.014.66560[11, 405]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075409__680.json0.0missingmissingmissing
9039Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231225_114303__52300.02.693870[381, 33]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114303__523.json0.0missing{\n "num_gpu": 99\n}missing
9040Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_114311__59550.08.525214[381, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114311__595.json100.0missing{\n "num_gpu": 99\n}missing
9041Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231227_011656__49600.02.557180[381, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011656__496.json0.0missing{\n "num_gpu": 99\n}missing
9042Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231214_075354__65200.021.16720[369, 493]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_075354__652.json50.0missingmissingmissing
9043Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_114246__27150.07.848824[379, 201]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_114246__271.json100.0missing{\n "num_gpu": 99\n}missing
9044Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_114300__74450.013.57534[379, 383]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_114300__744.json100.0missing{\n "num_gpu": 99\n}missing
9045Apple-MacBook-Pro-M1keep_only_namesopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_011653__51850.08.462814[379, 219]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_011653__518.json100.0missing{\n "num_gpu": 99\n}missing
9046Apple-MacBook-Pro-M1keep_only_namesorca2:13bAsIs1SHOTfalsefalse520231214_080230__66000.010.39560[52, 315]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__AsIs__1SHOT__20231214_080230__660.json0.0missingmissingmissing
9047Apple-MacBook-Pro-M1keep_only_namesorca2:13bAsIs1SHOTfalsefalse520231225_115927__76600.013.54710[69, 245]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__AsIs__1SHOT__20231225_115927__766.json0.0missing{\n "num_gpu": 99\n}missing
9048Apple-MacBook-Pro-M1keep_only_namesorca2:13bAsIs1SHOTfalsefalse520231225_115938__87900.010.74320[69, 192]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__AsIs__1SHOT__20231225_115938__879.json0.0missing{\n "num_gpu": 99\n}missing
9049Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTfalsefalse520231214_080220__84400.010.69570[69, 319]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231214_080220__844.json0.0missingmissingmissing
9050Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruetrue520231225_115903__34630.010.32014[72, 184]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231225_115903__346.json90.0missing{\n "num_gpu": 99\n}missing
9051Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruetrue520231225_115913__58930.09.800384[72, 174]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231225_115913__589.json90.0missing{\n "num_gpu": 99\n}missing
9052Apple-MacBook-Pro-M1keep_only_namesorca2:13bInJulia1SHOTtruetrue520231227_012452__17600.010.49620[72, 186]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__InJulia__1SHOT__20231227_012452__176.json50.0missing{\n "num_gpu": 99\n}missing
9053Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_080209__44910.06.831980[98, 193]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_080209__449.json55.0missingmissingmissing
9054Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_115843__53600.04.546590[111, 68]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_115843__536.json0.0missing{\n "num_gpu": 99\n}missing
9055Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_115853__19100.09.973660[111, 172]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_115853__191.json0.0missing{\n "num_gpu": 99\n}missing
9056Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertAsk1SHOTtruetrue520231227_012442__44030.09.191854[111, 156]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_012442__440.json90.0missing{\n "num_gpu": 99\n}missing
9057Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_080202__31550.012.77314[188, 341]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080202__315.json100.0missingmissingmissing
9058Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_115820__13630.029.41974[201, 341]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115820__136.json90.0missing{\n "num_gpu": 99\n}missing
9059Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_115838__45600.017.90230[201, 303]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115838__456.json50.0missing{\n "num_gpu": 99\n}missing
9060Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231227_012432__95800.041.70040[201, 566]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012432__958.json50.0missing{\n "num_gpu": 99\n}missing
9061Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231214_080315__27200.020.24660[11, 549]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080315__272.json25.0missingmissingmissing
9062Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_120050__95900.039.45560[375, 645]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120050__959.json50.0missing{\n "num_gpu": 99\n}missing
9063Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_120114__45300.023.43650[375, 370]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120114__453.json0.0missing{\n "num_gpu": 99\n}missing
9064Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_012521__95100.012.76350[375, 178]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012521__951.json0.0missing{\n "num_gpu": 99\n}missing
9065Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTtruetrue520231214_080255__61000.024.24770[369, 572]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_080255__610.json50.0missingmissingmissing
9066Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTtruetrue520231225_115950__57000.012.8690[372, 181]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_115950__570.json50.0missing{\n "num_gpu": 99\n}missing
9067Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_120010__85800.019.97410[372, 309]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_120010__858.json0.0missing{\n "num_gpu": 99\n}missing
9068Apple-MacBook-Pro-M1keep_only_namesorca2:13bJuliaRecapTask1SHOTtruetrue520231227_012508__51510.015.64590[372, 230]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_012508__515.json55.0missing{\n "num_gpu": 99\n}missing
9069Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_122304__65400.019.56710[62, 744]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_122304__654.json0.0missing{\n "num_gpu": 99\n}missing
9070Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_122320__37100.016.16170[62, 621]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_122320__371.json0.0missing{\n "num_gpu": 99\n}missing
9071Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_122243__49200.015.41930[65, 592]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_122243__492.json0.0missing{\n "num_gpu": 99\n}missing
9072Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_122244__85900.01.408730[65, 48]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_122244__859.json0.0missing{\n "num_gpu": 99\n}missing
9073Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_013451__66400.02.359110[65, 86]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_013451__664.json0.0missing{\n "num_gpu": 99\n}missing
9074Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_122211__32400.018.1380[102, 681]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_122211__324.json0.0missing{\n "num_gpu": 99\n}missing
9075Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_122227__81800.016.1590[102, 611]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_122227__818.json0.0missing{\n "num_gpu": 99\n}missing
9076Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_013449__99300.01.391270[102, 43]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_013449__993.json0.0missing{\n "num_gpu": 99\n}missing
9077Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_122151__63500.04.419180[190, 8]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122151__635.json0.0missing{\n "num_gpu": 99\n}missing
9078Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_122153__48100.01.66720[190, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122153__481.json0.0missing{\n "num_gpu": 99\n}missing
9079Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_013448__49800.04.416910[190, 8]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013448__498.json0.0missing{\n "num_gpu": 99\n}missing
9080Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_122329__61900.01.214240[354, 1]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122329__619.json0.0missing{\n "num_gpu": 99\n}missing
9081Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_122330__64300.01.228920[354, 1]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122330__643.json0.0missing{\n "num_gpu": 99\n}missing
9082Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_013458__70200.01.216670[354, 1]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013458__702.json0.0missing{\n "num_gpu": 99\n}missing
9083Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_122325__66700.05.627830[351, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_122325__667.json0.0missing{\n "num_gpu": 99\n}missing
9084Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_122328__69200.02.452680[351, 52]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_122328__692.json0.0missing{\n "num_gpu": 99\n}missing
9085Apple-MacBook-Pro-M1keep_only_namesphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_013457__10600.05.218910[351, 157]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_013457__106.json0.0missing{\n "num_gpu": 99\n}missing
9086Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_080403__36500.010.2240[52, 310]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_080403__365.json0.0missingmissingmissing
9087Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_120452__51900.022.3910[77, 168]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_120452__519.json0.0missing{\n "num_gpu": 99\n}missing
9088Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_120505__66100.013.37250[77, 94]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_120505__661.json0.0missing{\n "num_gpu": 99\n}missing
9089Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTfalsefalse520231214_080352__89600.010.56650[69, 316]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_080352__896.json0.0missingmissingmissing
9090Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_120347__37730.034.55674[80, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_120347__377.json90.0missing{\n "num_gpu": 99\n}missing
9091Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_120429__33930.041.70464[80, 325]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_120429__339.json90.0missing{\n "num_gpu": 99\n}missing
9092Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_012725__14450.029.39914[80, 223]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_012725__144.json100.0missing{\n "num_gpu": 99\n}missing
9093Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_080342__88710.09.602260[98, 276]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_080342__887.json55.0missingmissingmissing
9094Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_120305__80330.018.97464[119, 135]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_120305__803.json90.0missing{\n "num_gpu": 99\n}missing
9095Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_120313__21430.07.30034[119, 39]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_120313__214.json90.0missing{\n "num_gpu": 99\n}missing
9096Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_012656__66100.043.82574[119, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_012656__661.json75.0missing{\n "num_gpu": 99\n}missing
9097Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231214_080332__51720.016.86684[188, 455]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080332__517.json85.0missingmissingmissing
9098Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_120211__66330.057.83744[209, 256]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120211__663.json90.0missing{\n "num_gpu": 99\n}missing
9099Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_120246__10030.034.57054[209, 244]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_120246__100.json90.0missing{\n "num_gpu": 99\n}missing
9100Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231227_012612__64900.051.21410[209, 210]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012612__649.json0.0missing{\n "num_gpu": 99\n}missing
9101Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_080421__82400.01.337740[11, 33]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080421__824.json0.0missingmissingmissing
9102Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231225_120701__68400.022.20760[383, 115]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120701__684.json25.0missing{\n "num_gpu": 99\n}missing
9103Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_120751__36230.049.89224[383, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_120751__362.json90.0missing{\n "num_gpu": 99\n}missing
9104Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_012833__52500.037.1690[383, 232]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012833__525.json50.0missing{\n "num_gpu": 99\n}missing
9105Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_080420__58110.016.85920[369, 380]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_080420__581.json55.0missingmissingmissing
9106Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_120551__19230.046.04774[380, 303]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_120551__192.json90.0missing{\n "num_gpu": 99\n}missing
9107Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_120638__49530.047.0564[380, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_120638__495.json90.0missing{\n "num_gpu": 99\n}missing
9108Apple-MacBook-Pro-M1keep_only_namesphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_012756__23730.030.47194[380, 180]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_012756__237.json90.0missing{\n "num_gpu": 99\n}missing
9109Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_121640__34000.012.98940[72, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_121640__340.json0.0missing{\n "num_gpu": 99\n}missing
9110Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_121650__42300.09.851130[72, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_121650__423.json0.0missing{\n "num_gpu": 99\n}missing
9111Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_121615__29410.015.82220[75, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_121615__294.json55.0missing{\n "num_gpu": 99\n}missing
9112Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_121627__96250.011.85054[75, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_121627__962.json100.0missing{\n "num_gpu": 99\n}missing
9113Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231227_013215__19400.013.65220[75, 228]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_013215__194.json0.0missing{\n "num_gpu": 99\n}missing
9114Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121545__79230.013.85654[116, 227]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121545__792.json90.0missing{\n "num_gpu": 99\n}missing
9115Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_121559__18810.014.06930[116, 231]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_121559__188.json55.0missing{\n "num_gpu": 99\n}missing
9116Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_013201__51400.013.04670[116, 212]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_013201__514.json50.0missing{\n "num_gpu": 99\n}missing
9117Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_121515__62710.027.82380[206, 294]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121515__627.json55.0missing{\n "num_gpu": 99\n}missing
9118Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_121531__57600.016.04360[206, 250]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_121531__576.json0.0missing{\n "num_gpu": 99\n}missing
9119Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_013148__75700.023.10940[206, 226]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013148__757.json0.0missing{\n "num_gpu": 99\n}missing
9120Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121749__96810.022.6780[383, 336]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121749__968.json55.0missing{\n "num_gpu": 99\n}missing
9121Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_121811__74710.021.67390[383, 319]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_121811__747.json55.0missing{\n "num_gpu": 99\n}missing
9122Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_013255__15150.015.18884[383, 209]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013255__151.json100.0missing{\n "num_gpu": 99\n}missing
9123Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_121705__83850.015.55064[381, 216]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121705__838.json100.0missing{\n "num_gpu": 99\n}missing
9124Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_121727__22400.021.06420[381, 309]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_121727__224.json0.0missing{\n "num_gpu": 99\n}missing
9125Apple-MacBook-Pro-M1keep_only_namessolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_013240__19810.024.82470[381, 370]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_013240__198.json55.0missing{\n "num_gpu": 99\n}missing
9126Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrAsIs1SHOTfalsefalse520231214_080103__11800.08.248420[52, 251]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_080103__118.json0.0missingmissingmissing
9127Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrAsIs1SHOTfalsefalse520231225_115727__34200.01.988750[72, 108]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_115727__342.json0.0missing{\n "num_gpu": 99\n}missing
9128Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrAsIs1SHOTfalsefalse520231225_115730__31300.03.000150[72, 170]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_115730__313.json0.0missing{\n "num_gpu": 99\n}missing
9129Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTfalsefalse520231214_080055__85100.010.66180[69, 318]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_080055__851.json0.0missingmissingmissing
9130Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruefalse520231225_115719__29300.04.977640[75, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_115719__293.json25.0missing{\n "num_gpu": 99\n}missing
9131Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruetrue520231225_115725__62500.05.112450[75, 291]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_115725__625.json50.0missing{\n "num_gpu": 99\n}missing
9132Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrInJulia1SHOTtruefalse520231227_012339__17100.05.480430[75, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_012339__171.json25.0missing{\n "num_gpu": 99\n}missing
9133Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_080044__28250.06.170264[98, 172]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_080044__282.json100.0missingmissingmissing
9134Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_115708__26900.01.375960[112, 67]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_115708__269.json0.0missing{\n "num_gpu": 99\n}missing
9135Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_115714__10100.06.074260[112, 340]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_115714__101.json0.0missing{\n "num_gpu": 99\n}missing
9136Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_012334__87200.04.828180[112, 267]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_012334__872.json0.0missing{\n "num_gpu": 99\n}missing
9137Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_080038__28810.018.12340[188, 489]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080038__288.json55.0missingmissingmissing
9138Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_115704__31700.06.110640[197, 173]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115704__317.json0.0missing{\n "num_gpu": 99\n}missing
9139Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_115707__68100.03.400530[197, 168]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_115707__681.json0.0missing{\n "num_gpu": 99\n}missing
9140Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_012329__16700.011.15610[197, 439]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_012329__167.json0.0missing{\n "num_gpu": 99\n}missing
9141Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231214_080149__30300.022.24930[11, 599]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080149__303.json25.0missingmissingmissing
9142Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_115746__48700.05.75090[362, 254]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115746__487.json0.0missing{\n "num_gpu": 99\n}missing
9143Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_115751__80200.05.300940[362, 233]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115751__802.json0.0missing{\n "num_gpu": 99\n}missing
9144Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231227_012351__54500.05.770680[362, 257]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012351__545.json50.0missing{\n "num_gpu": 99\n}missing
9145Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_080127__18800.023.620[369, 555]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_080127__188.json50.0missingmissingmissing
9146Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTtruefalse520231225_115735__92300.04.590240[360, 188]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_115735__923.json25.0missing{\n "num_gpu": 99\n}missing
9147Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_115740__28400.04.940260[360, 213]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_115740__284.json0.0missing{\n "num_gpu": 99\n}missing
9148Apple-MacBook-Pro-M1keep_only_namesstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_012345__39200.05.324640[360, 234]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_012345__392.json0.0missing{\n "num_gpu": 99\n}missing
9149Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestAsIs1SHOTfalsefalse520231214_075446__85700.09.793750[52, 298]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_075446__857.json0.0missingmissingmissing
9150Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestAsIs1SHOTfalsefalse520231225_114424__41300.07.531450[72, 240]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_114424__413.json0.0missing{\n "num_gpu": 99\n}missing
9151Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestAsIs1SHOTfalsefalse520231225_114429__31800.04.375490[72, 134]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_114429__318.json0.0missing{\n "num_gpu": 99\n}missing
9152Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTfalsefalse520231214_075436__54100.09.907120[69, 295]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_075436__541.json0.0missingmissingmissing
9153Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruetrue520231225_114412__64320.08.554794[75, 274]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_114412__643.json85.0missing{\n "num_gpu": 99\n}missing
9154Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruetrue520231225_114417__31210.04.70010[75, 144]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_114417__312.json55.0missing{\n "num_gpu": 99\n}missing
9155Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestInJulia1SHOTtruetrue520231227_011727__39210.06.602040[75, 208]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_011727__392.json55.0missing{\n "num_gpu": 99\n}missing
9156Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_075426__29320.07.265524[98, 205]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_075426__293.json85.0missingmissingmissing
9157Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_114355__29010.08.655110[116, 272]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_114355__290.json55.0missing{\n "num_gpu": 99\n}missing
9158Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_114403__88620.07.697264[116, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_114403__886.json85.0missing{\n "num_gpu": 99\n}missing
9159Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_011720__31310.06.005220[116, 182]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_011720__313.json55.0missing{\n "num_gpu": 99\n}missing
9160Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231214_075419__42310.010.03510[188, 263]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075419__423.json55.0missingmissingmissing
9161Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_114332__50550.020.75294[206, 472]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114332__505.json100.0missing{\n "num_gpu": 99\n}missing
9162Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_114346__13750.014.34724[206, 439]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114346__137.json100.0missing{\n "num_gpu": 99\n}missing
9163Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_011714__12350.018.15284[206, 394]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011714__123.json100.0missing{\n "num_gpu": 99\n}missing
9164Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_075516__78900.010.16560[11, 283]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075516__789.json0.0missingmissingmissing
9165Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_114456__60320.09.281174[383, 246]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114456__603.json85.0missing{\n "num_gpu": 99\n}missing
9166Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_114506__91510.09.74610[383, 261]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_114506__915.json55.0missing{\n "num_gpu": 99\n}missing
9167Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_011755__64010.09.169010[383, 241]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_011755__640.json55.0missing{\n "num_gpu": 99\n}missing
9168Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_075506__42310.019.40930[369, 447]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_075506__423.json55.0missingmissingmissing
9169Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_114439__58810.010.49160[381, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_114439__588.json55.0missing{\n "num_gpu": 99\n}missing
9170Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_114447__15150.07.19254[381, 179]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_114447__151.json100.0missing{\n "num_gpu": 99\n}missing
9171Apple-MacBook-Pro-M1keep_only_namesstarling-lm:latestJuliaRecapTask1SHOTfalsefalse520231227_011746__92500.018.95190[381, 544]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_011746__925.json0.0missing{\n "num_gpu": 99\n}missing
9172Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatAsIs1SHOTfalsefalse520231214_075546__81500.06.8890[52, 208]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_075546__815.json0.0missingmissingmissing
9173Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatAsIs1SHOTfalsefalse520231225_114911__97600.023.12710[68, 169]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_114911__976.json0.0missing{\n "num_gpu": 99\n}missing
9174Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatAsIs1SHOTfalsefalse520231225_114943__14200.031.64390[68, 236]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_114943__142.json0.0missing{\n "num_gpu": 99\n}missing
9175Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTfalsefalse520231214_075539__86800.09.751060[69, 291]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_075539__868.json0.0missingmissingmissing
9176Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruetrue520231225_114804__47610.070.69030[71, 536]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_114804__476.json55.0missing{\n "num_gpu": 99\n}missing
9177Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruefalse520231225_114848__70000.043.50710[71, 328]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_114848__700.json25.0missing{\n "num_gpu": 99\n}missing
9178Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatInJulia1SHOTtruetrue520231227_011947__67710.058.50350[71, 441]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_011947__677.json55.0missing{\n "num_gpu": 99\n}missing
9179Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_075529__29210.07.707360[98, 220]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_075529__292.json55.0missingmissingmissing
9180Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_114629__36550.07.109414[110, 36]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_114629__365.json100.0missing{\n "num_gpu": 99\n}missing
9181Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_114654__22110.023.88520[110, 169]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_114654__221.json55.0missing{\n "num_gpu": 99\n}missing
9182Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_011848__59950.014.30994[110, 93]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_011848__599.json100.0missing{\n "num_gpu": 99\n}missing
9183Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231214_075522__50300.05.576920[188, 130]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_075522__503.json0.0missingmissingmissing
9184Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_114552__74310.045.60224[200, 139]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114552__743.json80.0missing{\n "num_gpu": 99\n}missing
9185Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_114622__10250.030.52974[200, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_114622__102.json100.0missing{\n "num_gpu": 99\n}missing
9186Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231227_011834__85700.038.62920[200, 92]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_011834__857.json25.0missing{\n "num_gpu": 99\n}missing
9187Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_075622__35000.016.24840[11, 445]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_075622__350.json50.0missingmissingmissing
9188Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_115110__62610.015.45740[384, 59]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115110__626.json55.0missing{\n "num_gpu": 99\n}missing
9189Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_115209__11450.059.13564[384, 388]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_115209__114.json100.0missing{\n "num_gpu": 99\n}missing
9190Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231227_012139__67700.063.09620[384, 416]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_012139__677.json50.0missing{\n "num_gpu": 99\n}missing
9191Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_075606__26610.019.30830[369, 444]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_075606__266.json55.0missingmissingmissing
9192Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_115020__15250.036.92084[382, 222]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_115020__152.json100.0missing{\n "num_gpu": 99\n}missing
9193Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_115055__16400.034.25840[382, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_115055__164.json50.0missing{\n "num_gpu": 99\n}missing
9194Apple-MacBook-Pro-M1keep_only_namesyi:34b-chatJuliaRecapTask1SHOTtruefalse520231227_012035__15400.048.21870[382, 306]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/keep_only_names/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_012035__154.json25.0missing{\n "num_gpu": 99\n}missing
9195Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructAsIs1SHOTfalsefalse520231214_081315__42000.020.79420[53, 611]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_081315__420.json0.0missingmissingmissing
9196Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructAsIs1SHOTfalsefalse520231225_125113__34100.026.20860[75, 481]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_125113__341.json0.0missing{\n "num_gpu": 99\n}missing
9197Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructAsIs1SHOTfalsefalse520231225_125126__26100.012.43190[75, 224]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_125126__261.json0.0missing{\n "num_gpu": 99\n}missing
9198Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTtruefalse520231214_081254__78500.016.72850[70, 493]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_081254__785.json25.0missingmissingmissing
9199Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTfalsefalse520231225_125019__72500.025.7120[78, 473]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_125019__725.json0.0missing{\n "num_gpu": 99\n}missing
9200Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTtruefalse520231225_125047__53900.028.21690[78, 518]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_125047__539.json25.0missing{\n "num_gpu": 99\n}missing
9201Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructInJulia1SHOTtruefalse520231227_015034__56300.024.84720[78, 450]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_015034__563.json25.0missing{\n "num_gpu": 99\n}missing
9202Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_081237__35900.018.98570[99, 544]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_081237__359.json50.0missingmissingmissing
9203Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231225_124935__41400.018.74630[116, 338]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_124935__414.json25.0missing{\n "num_gpu": 99\n}missing
9204Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruefalse520231225_124953__38300.017.34740[116, 312]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_124953__383.json25.0missing{\n "num_gpu": 99\n}missing
9205Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_014809__33800.012.92041[116, 227]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_014809__338.json56.25missing{\n "num_gpu": 99\n}missing
9206Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruefalse520231214_081218__58400.020.69790[187, 558]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081218__584.json25.0missingmissingmissing
9207Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_124855__28800.042.05220[205, 564]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_124855__288.json50.0missing{\n "num_gpu": 99\n}missing
9208Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_124917__50300.022.0411[205, 380]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_124917__503.json56.25missing{\n "num_gpu": 99\n}missing
9209Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231227_014756__21300.042.10650[205, 568]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_014756__213.json0.0missing{\n "num_gpu": 99\n}missing
9210Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_081406__11900.021.10320[11, 570]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081406__119.json50.0missingmissingmissing
9211Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_125232__99300.020.86333[381, 326]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125232__993.json68.75missing{\n "num_gpu": 99\n}missing
9212Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_125307__92800.033.93360[381, 546]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125307__928.json50.0missing{\n "num_gpu": 99\n}missing
9213Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapCoTTask1SHOTtruefalse520231227_015125__15000.023.99870[381, 379]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015125__150.json25.0missing{\n "num_gpu": 99\n}missing
9214Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231214_081344__32900.029.27690[370, 694]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_081344__329.json25.0missingmissingmissing
9215Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231225_125156__59500.030.45160[378, 494]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_125156__595.json25.0missing{\n "num_gpu": 99\n}missing
9216Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_125211__96300.014.8190[378, 217]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_125211__963.json50.0missing{\n "num_gpu": 99\n}missing
9217Apple-MacBook-Pro-M1pig_latinifycodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231227_015101__83900.026.29850[378, 419]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_015101__839.json25.0missing{\n "num_gpu": 99\n}missing
9218NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_031134__75600.04.246150[0, 315]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_031134__756.json50.0missing{\n "num_gpu": 99\n}missing
9219NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_031141__76000.07.007280[0, 516]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_031141__760.json25.0missing{\n "num_gpu": 99\n}missing
9220NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_031146__81910.04.935744[0, 365]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_031146__819.json80.0missing{\n "num_gpu": 99\n}missing
9221NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_031158__55110.012.1762[0, 881]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_031158__551.json67.5missing{\n "num_gpu": 99\n}missing
9222NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_031206__38630.07.238614[0, 533]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_031206__386.json90.0missing{\n "num_gpu": 99\n}missing
9223NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_030143__27110.04.22532[0, 313]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_030143__271.json67.5missing{\n "num_gpu": 99\n}missing
9224NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_030146__96700.02.690320[0, 195]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_030146__967.json50.0missing{\n "num_gpu": 99\n}missing
9225NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_030149__96410.02.609321[0, 193]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_030149__964.json61.25missing{\n "num_gpu": 99\n}missing
9226NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_030152__74300.02.505530[0, 185]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_030152__743.json0.0missing{\n "num_gpu": 99\n}missing
9227NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_030154__65200.01.869621[0, 142]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_030154__652.json56.25missing{\n "num_gpu": 99\n}missing
9228NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_030057__42510.09.070632[0, 652]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_030057__425.json67.5missing{\n "num_gpu": 99\n}missing
9229NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_030102__44300.04.99250[0, 371]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_030102__443.json25.0missing{\n "num_gpu": 99\n}missing
9230NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_030109__21200.07.301460[0, 535]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_030109__212.json25.0missing{\n "num_gpu": 99\n}missing
9231NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_030115__76700.05.890870[0, 439]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_030115__767.json25.0missing{\n "num_gpu": 99\n}missing
9232NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_030119__75910.03.991711[0, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_030119__759.json61.25missing{\n "num_gpu": 99\n}missing
9233NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_031924__73300.03.516290[0, 257]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_031924__733.json25.0missing{\n "num_gpu": 99\n}missing
9234NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_031931__85100.06.934340[0, 505]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_031931__851.json50.0missing{\n "num_gpu": 99\n}missing
9235NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_031936__36100.05.419430[0, 395]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_031936__361.json50.0missing{\n "num_gpu": 99\n}missing
9236NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_031941__24900.04.687750[0, 342]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_031941__249.json25.0missing{\n "num_gpu": 99\n}missing
9237NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_031947__51230.05.819544[0, 426]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_031947__512.json90.0missing{\n "num_gpu": 99\n}missing
9238NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_031240__88700.04.258910[0, 313]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_031240__887.json50.0missing{\n "num_gpu": 99\n}missing
9239NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_031245__67600.05.419841[0, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_031245__676.json56.25missing{\n "num_gpu": 99\n}missing
9240NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_031249__45900.02.310480[0, 171]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_031249__459.json0.0missing{\n "num_gpu": 99\n}missing
9241NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_031256__60810.06.997071[0, 511]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_031256__608.json61.25missing{\n "num_gpu": 99\n}missing
9242NVIDIA-RTX-4090-4xpig_latinifycodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_031658__99200.01.566181[0, 107]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_031658__992.json56.25missing{\n "num_gpu": 99\n}missing
9243Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonAsIs1SHOTfalsefalse520231214_081519__17100.022.0430[53, 645]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_081519__171.json0.0missingmissingmissing
9244Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonAsIs1SHOTfalsefalse520231225_125506__41500.018.50990[49, 340]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_125506__415.json0.0missing{\n "num_gpu": 99\n}missing
9245Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonAsIs1SHOTfalsefalse520231225_125518__65100.011.66680[49, 213]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_125518__651.json0.0missing{\n "num_gpu": 99\n}missing
9246Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonInJulia1SHOTtruefalse520231214_081457__12600.013.84920[70, 411]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_081457__126.json25.0missingmissingmissing
9247Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonInJulia1SHOTfalsefalse520231225_125408__19600.020.39850[52, 377]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_125408__196.json0.0missing{\n "num_gpu": 99\n}missing
9248Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonInJulia1SHOTfalsefalse520231225_125448__62200.039.80910[52, 720]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_125448__622.json0.0missing{\n "num_gpu": 99\n}missing
9249Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231214_081443__68000.018.34410[99, 526]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_081443__680.json0.0missingmissingmissing
9250Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_125323__49200.01.609760[53, 20]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_125323__492.json0.0missing{\n "num_gpu": 99\n}missing
9251Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_125348__33800.024.62560[53, 450]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_125348__338.json0.0missing{\n "num_gpu": 99\n}missing
9252Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231214_081424__91600.018.66040[187, 504]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081424__916.json0.0missingmissingmissing
9253Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_125319__14000.012.35960[80, 28]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125319__140.json0.0missing{\n "num_gpu": 99\n}missing
9254Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_125321__91600.02.005120[80, 23]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125321__916.json0.0missing{\n "num_gpu": 99\n}missing
9255Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_081606__12200.023.91250[11, 640]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081606__122.json50.0missingmissingmissing
9256Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_125527__29700.01.375850[70, 11]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125527__297.json0.0missing{\n "num_gpu": 99\n}missing
9257Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_125530__31100.03.096350[70, 43]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_125530__311.json0.0missing{\n "num_gpu": 99\n}missing
9258Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231214_081542__81400.022.92110[370, 537]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_081542__814.json25.0missingmissingmissing
9259Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_125522__43800.03.600020[67, 54]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_125522__438.json25.0missing{\n "num_gpu": 99\n}missing
9260Apple-MacBook-Pro-M1pig_latinifycodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_125525__63300.03.646210[67, 55]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_125525__633.json0.0missing{\n "num_gpu": 99\n}missing
9261NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_034241__34810.013.18581[0, 475]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_034241__348.json61.25missing{\n "num_gpu": 99\n}missing
9262NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_034251__36300.09.634030[0, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_034251__363.json50.0missing{\n "num_gpu": 99\n}missing
9263NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_034301__53600.09.891150[0, 357]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_034301__536.json25.0missing{\n "num_gpu": 99\n}missing
9264NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_034311__81300.010.18440[0, 367]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_034311__813.json25.0missing{\n "num_gpu": 99\n}missing
9265NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_034324__63800.012.54330[0, 452]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_034324__638.json50.0missing{\n "num_gpu": 99\n}missing
9266NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_033523__98900.05.601830[0, 202]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_033523__989.json0.0missing{\n "num_gpu": 99\n}missing
9267NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_033533__37900.09.624620[0, 346]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_033533__379.json50.0missing{\n "num_gpu": 99\n}missing
9268NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_034051__64100.017.80940[116, 403]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_034051__641.json25.0missing{\n "num_gpu": 99\n}missing
9269NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_034102__12500.010.5071[0, 377]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_034102__125.json56.25missing{\n "num_gpu": 99\n}missing
9270NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_034112__12200.010.19880[0, 367]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_034112__122.json25.0missing{\n "num_gpu": 99\n}missing
9271NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_032848__55500.010.27520[0, 367]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_032848__555.json50.0missing{\n "num_gpu": 99\n}missing
9272NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_033403__95400.015.10670[205, 310]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_033403__954.json25.0missing{\n "num_gpu": 99\n}missing
9273NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_033412__23000.08.680110[0, 310]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_033412__230.json25.0missing{\n "num_gpu": 99\n}missing
9274NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_033423__93900.011.35980[0, 402]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_033423__939.json0.0missing{\n "num_gpu": 99\n}missing
9275NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_033440__16000.016.52940[0, 586]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_033440__160.json25.0missing{\n "num_gpu": 99\n}missing
9276NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_035407__85610.030.08171[0, 1062]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_035407__856.json61.25missing{\n "num_gpu": 99\n}missing
9277NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_035415__52400.08.569090[0, 303]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_035415__524.json0.0missing{\n "num_gpu": 99\n}missing
9278NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_035434__40100.018.40860[0, 651]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_035434__401.json25.0missing{\n "num_gpu": 99\n}missing
9279NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_035445__74600.010.80370[0, 383]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_035445__746.json0.0missing{\n "num_gpu": 99\n}missing
9280NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_035445__87400.00.1244840[0, 4]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_035445__874.json0.0missing{\n "num_gpu": 99\n}missing
9281NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_034445__95700.08.382811[0, 298]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_034445__957.json56.25missing{\n "num_gpu": 99\n}missing
9282NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_034456__69500.010.44440[0, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_034456__695.json0.0missing{\n "num_gpu": 99\n}missing
9283NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_034507__89510.010.70951[0, 381]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_034507__895.json61.25missing{\n "num_gpu": 99\n}missing
9284NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_034520__13210.013.44181[0, 477]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_034520__132.json61.25missing{\n "num_gpu": 99\n}missing
9285NVIDIA-RTX-4090-4xpig_latinifycodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_035248__49800.027.05950[378, 218]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_035248__498.json0.0missing{\n "num_gpu": 99\n}missing
9286NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_025343__77200.022.39870[84, 539]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_025343__772.json0.0missing{\n "num_gpu": 99\n}missing
9287NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_025401__16300.017.41850[0, 427]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_025401__163.json0.0missing{\n "num_gpu": 99\n}missing
9288NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_025425__85810.024.06452[0, 587]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_025425__858.json67.5missing{\n "num_gpu": 99\n}missing
9289NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_025444__54910.018.25711[0, 448]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_025444__549.json61.25missing{\n "num_gpu": 99\n}missing
9290NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_025503__54700.019.68040[0, 482]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_025503__547.json0.0missing{\n "num_gpu": 99\n}missing
9291NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_024943__86800.014.21850[0, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_024943__868.json0.0missing{\n "num_gpu": 99\n}missing
9292NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_025007__10310.023.73071[0, 577]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_025007__103.json61.25missing{\n "num_gpu": 99\n}missing
9293NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_025019__81500.011.29790[0, 276]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_025019__815.json0.0missing{\n "num_gpu": 99\n}missing
9294NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_025040__16410.020.85792[0, 508]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_025040__164.json67.5missing{\n "num_gpu": 99\n}missing
9295NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_025046__11200.06.65040[0, 163]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_025046__112.json0.0missing{\n "num_gpu": 99\n}missing
9296NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruefalse520240201_024528__97000.023.60890[0, 572]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_024528__970.json25.0missing{\n "num_gpu": 99\n}missing
9297NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_024739__21100.010.43430[0, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_024739__211.json0.0missing{\n "num_gpu": 99\n}missing
9298NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_024749__55000.09.911080[0, 243]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_024749__550.json0.0missing{\n "num_gpu": 99\n}missing
9299NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_024755__79500.06.189150[0, 152]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_024755__795.json0.0missing{\n "num_gpu": 99\n}missing
9300NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_024808__54710.013.31771[0, 324]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_024808__547.json61.25missing{\n "num_gpu": 99\n}missing
9301NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_025927__83400.07.646560[0, 185]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_025927__834.json0.0missing{\n "num_gpu": 99\n}missing
9302NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_025948__50200.021.27610[0, 511]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_025948__502.json50.0missing{\n "num_gpu": 99\n}missing
9303NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_025952__19800.03.170470[0, 77]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_025952__198.json0.0missing{\n "num_gpu": 99\n}missing
9304NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_030011__23000.018.94890[0, 456]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_030011__230.json50.0missing{\n "num_gpu": 99\n}missing
9305NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_030019__84900.07.780580[0, 186]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_030019__849.json0.0missing{\n "num_gpu": 99\n}missing
9306NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_025708__63600.016.03520[0, 386]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_025708__636.json0.0missing{\n "num_gpu": 99\n}missing
9307NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_025719__59800.010.99670[0, 265]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_025719__598.json0.0missing{\n "num_gpu": 99\n}missing
9308NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruefalse520240201_025727__45000.08.436410[0, 204]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_025727__450.json25.0missing{\n "num_gpu": 99\n}missing
9309NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruefalse520240201_025751__76400.023.88840[0, 574]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_025751__764.json25.0missing{\n "num_gpu": 99\n}missing
9310NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_025809__45900.017.31310[0, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_025809__459.json50.0missing{\n "num_gpu": 99\n}missing
9311NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_023406__78600.027.85980[0, 516]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_023406__786.json25.0missing{\n "num_gpu": 99\n}missing
9312NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_023440__65000.034.31960[0, 636]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_023440__650.json0.0missing{\n "num_gpu": 99\n}missing
9313NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_023502__74210.021.77081[0, 405]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_023502__742.json61.25missing{\n "num_gpu": 99\n}missing
9314NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_023534__86800.031.58290[0, 586]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_023534__868.json25.0missing{\n "num_gpu": 99\n}missing
9315NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_023559__15010.024.40191[0, 455]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_023559__150.json61.25missing{\n "num_gpu": 99\n}missing
9316NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_023015__81510.023.13222[0, 431]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_023015__815.json67.5missing{\n "num_gpu": 99\n}missing
9317NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_023042__45510.026.39111[0, 491]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_023042__455.json61.25missing{\n "num_gpu": 99\n}missing
9318NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_023112__35200.029.94940[0, 556]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_023112__352.json50.0missing{\n "num_gpu": 99\n}missing
9319NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_023114__66900.02.189390[0, 41]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_023114__669.json0.0missing{\n "num_gpu": 99\n}missing
9320NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_023141__34200.026.18330[0, 487]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_023141__342.json0.0missing{\n "num_gpu": 99\n}missing
9321NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022630__27400.014.45850[0, 269]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022630__274.json0.0missing{\n "num_gpu": 99\n}missing
9322NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_022645__73420.015.70162[0, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022645__734.json72.5missing{\n "num_gpu": 99\n}missing
9323NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_022720__11200.034.77060[0, 642]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022720__112.json0.0missing{\n "num_gpu": 99\n}missing
9324NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_022748__68510.027.55151[0, 511]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022748__685.json61.25missing{\n "num_gpu": 99\n}missing
9325NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_022805__41610.016.75131[0, 312]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_022805__416.json61.25missing{\n "num_gpu": 99\n}missing
9326NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_024241__56820.016.31962[0, 301]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_024241__568.json72.5missing{\n "num_gpu": 99\n}missing
9327NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_024253__15900.011.28270[0, 208]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_024253__159.json0.0missing{\n "num_gpu": 99\n}missing
9328NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_024303__82300.09.968540[0, 184]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_024303__823.json0.0missing{\n "num_gpu": 99\n}missing
9329NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_024321__80910.017.99311[0, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_024321__809.json61.25missing{\n "num_gpu": 99\n}missing
9330NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_024331__91800.010.17360[0, 188]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_024331__918.json0.0missing{\n "num_gpu": 99\n}missing
9331NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_023920__36500.060.06520[0, 1100]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_023920__365.json0.0missing{\n "num_gpu": 99\n}missing
9332NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_023941__27120.021.09982[0, 388]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_023941__271.json72.5missing{\n "num_gpu": 99\n}missing
9333NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_024000__99410.019.01094[0, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_024000__994.json80.0missing{\n "num_gpu": 99\n}missing
9334NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_024009__69000.08.962180[0, 165]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_024009__690.json0.0missing{\n "num_gpu": 99\n}missing
9335NVIDIA-RTX-4090-4xpig_latinifycodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_024032__19300.022.70340[0, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_024032__193.json25.0missing{\n "num_gpu": 99\n}missing
9336NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_032608__18300.01.962780[0, 231]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_032608__183.json25.0missing{\n "num_gpu": 99\n}missing
9337NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MInJulia1SHOTtruefalse520240201_032610__90200.01.330660[0, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_032610__902.json25.0missing{\n "num_gpu": 99\n}missing
9338NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_032611__36410.01.556571[0, 181]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_032611__364.json61.25missing{\n "num_gpu": 99\n}missing
9339NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_032613__74000.01.335170[0, 155]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_032613__740.json50.0missing{\n "num_gpu": 99\n}missing
9340NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_032614__18600.01.112684[0, 132]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_032614__186.json75.0missing{\n "num_gpu": 99\n}missing
9341NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_032034__48300.02.444740[0, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_032034__483.json0.0missing{\n "num_gpu": 99\n}missing
9342NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_032039__42300.05.443560[0, 647]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_032039__423.json50.0missing{\n "num_gpu": 99\n}missing
9343NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_032041__48300.00.9004384[0, 109]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_032041__483.json75.0missing{\n "num_gpu": 99\n}missing
9344NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_032042__22900.01.439550[0, 174]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_032042__229.json50.0missing{\n "num_gpu": 99\n}missing
9345NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520240201_032047__17800.04.802320[0, 577]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_032047__178.json25.0missing{\n "num_gpu": 99\n}missing
9346NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_032008__61700.02.974990[0, 346]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_032008__617.json0.0missing{\n "num_gpu": 99\n}missing
9347NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_032011__42010.03.028182[0, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_032011__420.json67.5missing{\n "num_gpu": 99\n}missing
9348NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_032013__72700.01.959780[0, 228]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_032013__727.json0.0missing{\n "num_gpu": 99\n}missing
9349NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520240201_032014__46500.01.154920[0, 134]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_032014__465.json25.0missing{\n "num_gpu": 99\n}missing
9350NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_032015__93800.00.7215820[0, 85]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_032015__938.json50.0missing{\n "num_gpu": 99\n}missing
9351NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_032722__12700.05.326430[0, 612]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_032722__127.json50.0missing{\n "num_gpu": 99\n}missing
9352NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_032726__38910.03.473622[0, 405]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_032726__389.json67.5missing{\n "num_gpu": 99\n}missing
9353NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_032732__32210.05.575114[0, 644]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_032732__322.json80.0missing{\n "num_gpu": 99\n}missing
9354NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_032736__22510.04.275441[0, 497]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_032736__225.json61.25missing{\n "num_gpu": 99\n}missing
9355NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_032738__72200.01.262810[0, 149]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_032738__722.json0.0missing{\n "num_gpu": 99\n}missing
9356NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_032642__89720.05.58554[0, 644]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_032642__897.json85.0missing{\n "num_gpu": 99\n}missing
9357NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_032646__61710.04.259384[0, 495]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_032646__617.json80.0missing{\n "num_gpu": 99\n}missing
9358NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520240201_032649__79100.02.599330[0, 304]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_032649__791.json25.0missing{\n "num_gpu": 99\n}missing
9359NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_032654__60600.04.751260[0, 551]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_032654__606.json50.0missing{\n "num_gpu": 99\n}missing
9360NVIDIA-RTX-4090-4xpig_latinifycodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_032657__14810.03.265344[0, 382]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_032657__148.json80.0missing{\n "num_gpu": 99\n}missing
9361Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_134213__29300.0127.4230[64, 777]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_134213__293.json0.0missing{\n "num_gpu": 99\n}missing
9362Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_134347__84400.093.64020[64, 575]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_134347__844.json0.0missing{\n "num_gpu": 99\n}missing
9363Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_133915__19900.050.91740[67, 308]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_133915__199.json25.0missing{\n "num_gpu": 99\n}missing
9364Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_134006__60310.050.60242[67, 306]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_134006__603.json67.5missing{\n "num_gpu": 99\n}missing
9365Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_020752__37300.054.7590[67, 331]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_020752__373.json50.0missing{\n "num_gpu": 99\n}missing
9366Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_133700__10800.070.37170[108, 422]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_133700__108.json50.0missing{\n "num_gpu": 99\n}missing
9367Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_133823__15940.082.86593[108, 498]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_133823__159.json88.75missing{\n "num_gpu": 99\n}missing
9368Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_020656__42200.047.8450[108, 283]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_020656__422.json25.0missing{\n "num_gpu": 99\n}missing
9369Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_133508__56820.083.08872[197, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_133508__568.json72.5missing{\n "num_gpu": 99\n}missing
9370Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_133550__55120.041.63442[197, 228]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_133550__551.json72.5missing{\n "num_gpu": 99\n}missing
9371Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_020609__96220.079.8692[197, 317]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_020609__962.json72.5missing{\n "num_gpu": 99\n}missing
9372Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_134740__98300.071.63210[396, 376]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_134740__983.json50.0missing{\n "num_gpu": 99\n}missing
9373Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_134848__15200.068.59640[396, 358]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_134848__152.json25.0missing{\n "num_gpu": 99\n}missing
9374Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_021005__23530.044.58882[396, 213]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021005__235.json77.5missing{\n "num_gpu": 99\n}missing
9375Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_134515__64100.088.14330[394, 474]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_134515__641.json25.0missing{\n "num_gpu": 99\n}missing
9376Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_134628__35330.071.69734[394, 376]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_134628__353.json90.0missing{\n "num_gpu": 99\n}missing
9377Apple-MacBook-Pro-M1pig_latinifydeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_020920__51530.088.19292[394, 474]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_020920__515.json77.5missing{\n "num_gpu": 99\n}missing
9378Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_022003__36700.011.84220[69, 454]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_022003__367.json0.0missing{\n "num_gpu": 99\n}missing
9379Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue520231227_123502__62310.010.90551[69, 420]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_123502__623.json61.25missing{\n "num_gpu": 99\n}missing
9380Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_123513__82300.011.70690[69, 450]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_123513__823.json25.0missing{\n "num_gpu": 99\n}missing
9381Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_123534__67800.020.19830[69, 757]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_123534__678.json0.0missing{\n "num_gpu": 99\n}missing
9382Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_021951__33700.013.60450[106, 513]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_021951__337.json0.0missing{\n "num_gpu": 99\n}missing
9383Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_123422__71300.011.53470[106, 437]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_123422__713.json0.0missing{\n "num_gpu": 99\n}missing
9384Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_123437__85100.015.08820[106, 568]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_123437__851.json0.0missing{\n "num_gpu": 99\n}missing
9385Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_123450__68100.013.66260[106, 516]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_123450__681.json0.0missing{\n "num_gpu": 99\n}missing
9386Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_021938__67100.011.26710[193, 284]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021938__671.json0.0missing{\n "num_gpu": 99\n}missing
9387Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_123340__51200.013.1310[193, 347]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123340__512.json0.0missing{\n "num_gpu": 99\n}missing
9388Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_123357__79400.017.16890[193, 621]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123357__794.json0.0missing{\n "num_gpu": 99\n}missing
9389Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_123410__24800.013.29740[193, 483]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123410__248.json0.0missing{\n "num_gpu": 99\n}missing
9390Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_022028__96900.011.87470[358, 396]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022028__969.json0.0missing{\n "num_gpu": 99\n}missing
9391Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_123652__25000.026.22190[358, 882]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123652__250.json0.0missing{\n "num_gpu": 99\n}missing
9392Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_123704__65700.011.90960[358, 398]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123704__657.json0.0missing{\n "num_gpu": 99\n}missing
9393Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_123719__11400.014.64310[358, 494]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_123719__114.json0.0missing{\n "num_gpu": 99\n}missing
9394Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_022016__96300.012.57210[355, 421]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_022016__963.json0.0missing{\n "num_gpu": 99\n}missing
9395Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_123555__34500.021.72960[355, 736]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_123555__345.json0.0missing{\n "num_gpu": 99\n}missing
9396Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_123610__55600.014.63530[355, 494]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_123610__556.json0.0missing{\n "num_gpu": 99\n}missing
9397Apple-MacBook-Pro-M1pig_latinifydolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_123626__31000.015.72510[355, 532]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_123626__310.json0.0missing{\n "num_gpu": 99\n}missing
9398Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_111527__36700.05.53420[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111527__367.json25.0missingmissingmissing
9399Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_111530__81300.03.320460[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111530__813.json25.0missingmissingmissing
9400Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_111533__18300.02.537050[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111533__183.json25.0missingmissingmissing
9401Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_111538__80700.04.850960[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111538__807.json25.0missingmissingmissing
9402Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_111541__69000.02.708090[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_111541__690.json25.0missingmissingmissing
9403Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111448__76100.03.438330[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111448__761.json50.0missingmissingmissing
9404Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111450__21200.02.841710[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111450__212.json50.0missingmissingmissing
9405Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_111452__15600.01.936340[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111452__156.json25.0missingmissingmissing
9406Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_111457__46000.04.205320[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111457__460.json25.0missingmissingmissing
9407Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_111500__66800.03.559570[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111500__668.json25.0missingmissingmissing
9408Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_111356__48500.05.45750[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111356__485.json25.0missingmissingmissing
9409Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111404__54600.07.821274[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111404__546.json75.0missingmissingmissing
9410Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_111410__99800.05.77180[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111410__998.json0.0missingmissingmissing
9411Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_111414__95900.04.042150[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111414__959.json25.0missingmissingmissing
9412Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_111418__86000.04.059220[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111418__860.json25.0missingmissingmissing
9413Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111747__34600.03.805060[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111747__346.json25.0missingmissingmissing
9414Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_111751__91400.03.746340[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111751__914.json0.0missingmissingmissing
9415Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_111754__27400.03.132160[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111754__274.json0.0missingmissingmissing
9416Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_111802__88000.07.464660[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111802__880.json0.0missingmissingmissing
9417Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_111807__65600.04.894940[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_111807__656.json25.0missingmissingmissing
9418Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_111627__21000.06.902950[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111627__210.json0.0missingmissingmissing
9419Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_111634__24500.06.632720[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111634__245.json0.0missingmissingmissing
9420Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_111640__77000.06.272290[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111640__770.json25.0missingmissingmissing
9421Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_111655__67300.013.98260[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111655__673.json0.0missingmissingmissing
9422Apple-MacBook-Pro-M1pig_latinifygemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_111658__17310.03.871171[0, 0]0.13.0-DEV41.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_111658__173.json61.25missingmissingmissing
9423Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_235832__71100.030.82240[0, 470]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_235832__711.json0.0missingmissingmissing
9424Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_235855__34600.022.55720[0, 347]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_235855__346.json0.0missingmissingmissing
9425Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240223_235920__89300.025.41010[0, 387]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_235920__893.json0.0missingmissingmissing
9426Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240223_235945__67600.024.21410[0, 370]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240223_235945__676.json50.0missingmissingmissing
9427Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240224_000007__47800.022.38410[0, 339]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_000007__478.json0.0missingmissingmissing
9428Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240223_235447__69800.019.05110[0, 289]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_235447__698.json25.0missingmissingmissing
9429Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_235507__17000.020.31980[0, 310]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_235507__170.json0.0missingmissingmissing
9430Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_235527__10800.020.06350[0, 310]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_235527__108.json0.0missingmissingmissing
9431Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240223_235547__25500.019.61310[0, 296]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_235547__255.json50.0missingmissingmissing
9432Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240223_235606__10600.018.69730[0, 286]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240223_235606__106.json0.0missingmissingmissing
9433Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_235130__93900.025.63310[0, 388]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_235130__939.json0.0missingmissingmissing
9434Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_235150__14800.019.9140[0, 305]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_235150__148.json0.0missingmissingmissing
9435Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240223_235213__24700.023.09960[0, 352]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_235213__247.json25.0missingmissingmissing
9436Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240223_235236__33300.023.05844[0, 350]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_235236__333.json75.0missingmissingmissing
9437Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240223_235306__45100.029.62220[0, 450]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240223_235306__451.json0.0missingmissingmissing
9438Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240224_000812__52000.028.82090[0, 435]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_000812__520.json0.0missingmissingmissing
9439Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_000847__35210.035.59771[0, 540]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_000847__352.json61.25missingmissingmissing
9440Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240224_000927__46000.039.80170[0, 602]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_000927__460.json0.0missingmissingmissing
9441Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse520240224_001001__27300.033.63710[0, 509]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_001001__273.json25.0missingmissingmissing
9442Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240224_001035__59200.033.76420[0, 509]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_001035__592.json0.0missingmissingmissing
9443Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240224_000308__96000.028.84510[0, 435]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_000308__960.json0.0missingmissingmissing
9444Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse520240224_000335__47800.026.86660[0, 407]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_000335__478.json25.0missingmissingmissing
9445Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruefalse520240224_000405__95100.029.95730[0, 455]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_000405__951.json25.0missingmissingmissing
9446Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240224_000433__25700.027.78560[0, 420]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_000433__257.json0.0missingmissingmissing
9447Apple-MacBook-Pro-M1pig_latinifygemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240224_000503__23000.029.91640[0, 447]0.13.0-DEV41.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_000503__230.json0.0missingmissingmissing
9448Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboAsIs1SHOTfalsefalse520231213_203759__96000.000554512.97030[59, 350]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_203759__960.json0.0missingmissingmissing
9449Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboAsIs1SHOTfalsefalse520231225_195043__58700.00053655.705730[59, 338]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_195043__587.json0.0missingmissingmissing
9450Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboAsIs1SHOTfalsefalse520231225_195048__99200.0005174.809250[59, 325]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_195048__992.json0.0missingmissingmissing
9451Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_200250__90100.07.122890[59, 311]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_200250__901.json0.00.5missing0.5
9452Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboInJulia1SHOTtruefalse520231213_203746__54700.00076611.51360[62, 490]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_203746__547.json25.0missingmissingmissing
9453Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboInJulia1SHOTtruetrue520231225_195031__26510.000646.85732[62, 406]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_195031__265.json67.5missingmissingmissing
9454Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboInJulia1SHOTtruetrue520231225_195037__91410.0005565.748921[62, 350]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_195037__914.json61.25missingmissingmissing
9455Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboInJulia1SHOTtruefalse520231227_202516__13000.00062357.886850[62, 395]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_202516__130.json25.0missingmissingmissing
9456Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboInJulia1SHOTtruetrue520231227_202524__16710.00068357.713141[62, 435]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_202524__167.json61.25missingmissingmissing
9457Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_200243__17000.08.495460[62, 414]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_200243__170.json50.00.5missing0.5
9458Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertAsk1SHOTtruefalse520231213_203734__72800.00057.247730[97, 301]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_203734__728.json25.0missingmissingmissing
9459Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertAsk1SHOTtruefalse520231225_195019__41100.00053155.850330[97, 322]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_195019__411.json25.0missingmissingmissing
9460Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertAsk1SHOTtruefalse520231225_195024__17500.0004255.346260[97, 251]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_195024__175.json25.0missingmissingmissing
9461Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertAsk1SHOTfalsefalse520231227_202503__71800.00039954.149310[97, 234]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_202503__718.json0.0missingmissingmissing
9462Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_202508__77920.0004735.160332[97, 283]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_202508__779.json72.5missingmissingmissing
9463Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruefalse520231215_200234__47000.08.233310[97, 352]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_200234__470.json25.00.5missing0.5
9464Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_203727__37800.000283.614650[170, 130]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203727__378.json0.0missingmissingmissing
9465Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_195009__95000.0002382.518290[170, 102]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_195009__950.json0.0missingmissingmissing
9466Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_195013__29200.0004274.030070[170, 228]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_195013__292.json0.0missingmissingmissing
9467Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_202449__88500.00022751.974290[170, 95]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202449__885.json0.0missingmissingmissing
9468Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_202458__48940.00093259.518674[170, 565]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202458__489.json95.0missingmissingmissing
9469Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTtruetrue520231215_200226__39930.07.689262[170, 343]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_200226__399.json77.50.5missing0.5
9470Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231213_203805__25800.00039853.812130[320, 159]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203805__258.json0.0missingmissingmissing
9471Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_195056__66800.00051253.25480[320, 235]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_195056__668.json0.0missingmissingmissing
9472Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231225_195101__77300.00064154.734180[320, 321]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_195101__773.json50.0missingmissingmissing
9473Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_202544__40300.00047053.385420[320, 207]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202544__403.json0.0missingmissingmissing
9474Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_202546__55200.0003162.04420[320, 104]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202546__552.json0.0missingmissingmissing
9475Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_200255__69200.02.321620[320, 101]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_200255__692.json0.00.5missing0.5
9476Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_203801__82600.000292.562770[319, 87]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_203801__826.json0.0missingmissingmissing
9477Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_195050__60600.00032152.204310[319, 108]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_195050__606.json0.0missingmissingmissing
9478Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_195053__65500.00036352.80540[319, 136]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_195053__655.json0.0missingmissingmissing
9479Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapTask1SHOTtruetrue520231227_202539__85120.00152915.32634[319, 913]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_202539__851.json85.0missingmissingmissing
9480Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_202541__11900.00027951.780940[319, 80]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_202541__119.json0.0missingmissingmissing
9481Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_200253__38700.02.80690[319, 118]0.10.0-DEV41.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_200253__387.json0.00.5missing0.5
9482Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125InJulia1SHOTtruefalse520240201_200610__83200.00045552.172320[62, 283]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200610__832.json25.0missingmissingmissing
9483Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200612__77730.00049452.197342[62, 309]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200612__777.json77.5missingmissingmissing
9484Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200615__91720.0005742.89742[62, 362]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200615__917.json72.5missingmissingmissing
9485Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125InJulia1SHOTtruefalse520240201_200618__21000.00056052.460640[62, 353]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200618__210.json25.0missingmissingmissing
9486Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125InJulia1SHOTtruefalse520240201_200620__41600.00054252.563510[62, 341]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200620__416.json25.0missingmissingmissing
9487Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200601__73000.0003021.478820[97, 169]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200601__730.json50.0missingmissingmissing
9488Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200603__20100.00031251.562370[97, 176]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200603__201.json50.0missingmissingmissing
9489Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200605__76400.0003951.884860[97, 231]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200605__764.json50.0missingmissingmissing
9490Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200606__33700.0003141.313970[97, 177]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200606__337.json50.0missingmissingmissing
9491Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200608__66930.00033051.616752[97, 188]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200608__669.json77.5missingmissingmissing
9492Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200551__48200.00031151.383240[170, 151]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200551__482.json25.0missingmissingmissing
9493Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200554__86300.0004242.356170[170, 226]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200554__863.json25.0missingmissingmissing
9494Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200556__28200.00051252.017540[170, 285]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200556__282.json25.0missingmissingmissing
9495Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200557__43700.0002831.261810[170, 132]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200557__437.json25.0missingmissingmissing
9496Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200559__16200.00049151.900350[170, 271]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200559__162.json25.0missingmissingmissing
9497Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200630__70600.00034451.204770[320, 123]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200630__706.json0.0missingmissingmissing
9498Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200631__96800.0002350.686150[320, 50]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200631__968.json0.0missingmissingmissing
9499Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200632__50200.00031750.9419330[320, 105]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200632__502.json0.0missingmissingmissing
9500Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200633__34400.00030250.8398210[320, 95]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200633__344.json0.0missingmissingmissing
9501Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200634__14200.00031150.9476610[320, 101]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200634__142.json0.0missingmissingmissing
9502Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200621__76700.00030951.136960[319, 100]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200621__767.json0.0missingmissingmissing
9503Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200623__70000.00051651.755050[319, 238]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200623__700.json50.0missingmissingmissing
9504Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200625__14610.00049851.688131[319, 226]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200625__146.json61.25missingmissingmissing
9505Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200626__20630.0004371.369222[319, 185]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200626__206.json77.5missingmissingmissing
9506Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200629__49440.0006262.225484[319, 311]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200629__494.json95.0missingmissingmissing
9507Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_203822__40200.0007215.315020[59, 331]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_203822__402.json0.0missingmissingmissing
9508Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_224608__30300.0006993.423720[59, 320]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_224608__303.json0.0missingmissingmissing
9509Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_224612__80400.0007193.816350[59, 330]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_224612__804.json0.0missingmissingmissing
9510Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_200310__10100.04.670530[59, 273]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_200310__101.json0.00.9missing0.1
9511Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106InJulia1SHOTfalsefalse520231213_203817__72500.0007226.679340[62, 330]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_203817__725.json0.0missingmissingmissing
9512Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_224600__83100.0005962.83330[62, 267]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_224600__831.json50.0missingmissingmissing
9513Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106InJulia1SHOTtruefalse520231225_224604__25600.0007684.219870[62, 353]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_224604__256.json25.0missingmissingmissing
9514Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106InJulia1SHOTtruefalse520231227_202602__59400.000543.191870[62, 239]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_202602__594.json25.0missingmissingmissing
9515Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106InJulia1SHOTtruefalse520231227_202607__78500.000735.208350[62, 334]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_202607__785.json25.0missingmissingmissing
9516Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_200305__34800.04.235680[62, 251]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_200305__348.json50.00.9missing0.1
9517Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_203810__80710.0002391.550751[97, 71]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_203810__807.json61.25missingmissingmissing
9518Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertAsk1SHOTfalsefalse520231225_224555__91600.0002671.293350[97, 85]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_224555__916.json0.0missingmissingmissing
9519Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruefalse520231225_224557__40600.0004212.225970[97, 162]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_224557__406.json25.0missingmissingmissing
9520Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruefalse520231227_202554__91600.0004192.721330[97, 161]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_202554__916.json25.0missingmissingmissing
9521Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruefalse520231227_202559__65200.0005154.304720[97, 209]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_202559__652.json25.0missingmissingmissing
9522Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruefalse520231215_200301__72400.02.571650[97, 136]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_200301__724.json25.00.9missing0.1
9523Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231213_203809__86600.0004923.340970[170, 161]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203809__866.json25.0missingmissingmissing
9524Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231225_224553__59700.000492.026750[170, 160]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_224553__597.json25.0missingmissingmissing
9525Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_202549__12300.0004382.138050[170, 134]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202549__123.json25.0missingmissingmissing
9526Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_202552__97200.000522.992760[170, 175]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202552__972.json25.0missingmissingmissing
9527Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruefalse520231215_200258__23000.02.628050[170, 150]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_200258__230.json25.00.9missing0.1
9528Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231213_203829__60700.0005282.469730[320, 104]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_203829__607.json0.0missingmissingmissing
9529Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_224616__23700.0005581.528260[320, 119]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_224616__237.json0.0missingmissingmissing
9530Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_224618__83100.0005041.329190[320, 92]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_224618__831.json0.0missingmissingmissing
9531Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_202617__55200.000592.175640[320, 135]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202617__552.json0.0missingmissingmissing
9532Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_202619__74700.0004941.65550[320, 87]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_202619__747.json0.0missingmissingmissing
9533Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_200316__97000.02.02530[320, 108]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_200316__970.json0.00.9missing0.1
9534Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_203826__85330.0006773.926292[319, 179]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_203826__853.json77.5missingmissingmissing
9535Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_224613__54100.0004871.249770[319, 84]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_224613__541.json0.0missingmissingmissing
9536Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_224615__41900.0005611.763670[319, 121]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_224615__419.json0.0missingmissingmissing
9537Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_202611__10900.0006493.287580[319, 165]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_202611__109.json50.0missingmissingmissing
9538Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_202615__23520.0009054.499421[319, 293]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_202615__235.json66.25missingmissingmissing
9539Apple-MacBook-Pro-M1pig_latinifygpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_200313__17930.03.481912[319, 180]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_200313__179.json77.50.9missing0.1
9540Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewInJulia1SHOTtruetrue520240201_104645__36320.02177100.8322[62, 705]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_104645__363.json72.5missingmissingmissing
9541Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewInJulia1SHOTtruetrue520240201_104737__71830.0213551.73382[62, 691]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_104737__718.json77.5missingmissingmissing
9542Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewInJulia1SHOTtruefalse520240201_104824__35200.0182947.02680[62, 589]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_104824__352.json25.0missingmissingmissing
9543Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewInJulia1SHOTtruefalse520240201_104902__92700.0177237.16650[62, 570]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_104902__927.json25.0missingmissingmissing
9544Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewInJulia1SHOTtruetrue520240201_104946__53430.0202743.82172[62, 655]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_104946__534.json77.5missingmissingmissing
9545Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_103946__55920.015738.67022[97, 491]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_103946__559.json72.5missingmissingmissing
9546Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertAsk1SHOTtruefalse520240201_103956__25600.0056510.47720[97, 156]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_103956__256.json25.0missingmissingmissing
9547Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_104037__39520.0145640.83462[97, 453]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_104037__395.json72.5missingmissingmissing
9548Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_104118__81720.0164840.55352[97, 517]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_104118__817.json72.5missingmissingmissing
9549Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_104132__52730.0055613.72022[97, 153]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_104132__527.json77.5missingmissingmissing
9550Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_103348__45120.0266.08962[170, 610]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_103348__451.json72.5missingmissingmissing
9551Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_103426__93600.015538.26940[170, 460]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_103426__936.json25.0missingmissingmissing
9552Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_103515__76920.0177848.82292[170, 536]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_103515__769.json72.5missingmissingmissing
9553Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertCoTTask1SHOTtruefalse520240201_103603__81400.0195248.25120[170, 594]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_103603__814.json25.0missingmissingmissing
9554Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_103658__97930.0204554.68754[170, 625]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_103658__979.json90.0missingmissingmissing
9555Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_110313__81920.0208150.67152[320, 587]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_110313__819.json72.5missingmissingmissing
9556Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_110405__46100.0217451.62911[320, 618]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_110405__461.json56.25missingmissingmissing
9557Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapCoTTask1SHOTtruefalse520240201_110504__79900.0215959.16050[320, 613]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_110504__799.json25.0missingmissingmissing
9558Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapCoTTask1SHOTtruefalse520240201_110604__89400.0225259.98610[320, 644]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_110604__894.json25.0missingmissingmissing
9559Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_110654__57100.0239649.86531[320, 692]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_110654__571.json56.25missingmissingmissing
9560Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapTask1SHOTtruefalse520240201_105424__88600.0189140.06520[319, 524]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_105424__886.json25.0missingmissingmissing
9561Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapTask1SHOTtruefalse520240201_105508__56700.0190943.52150[319, 530]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_105508__567.json25.0missingmissingmissing
9562Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapTask1SHOTtruefalse520240201_105628__74300.0215880.49580[319, 613]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_105628__743.json25.0missingmissingmissing
9563Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_105709__53330.0184640.02134[319, 509]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_105709__533.json90.0missingmissingmissing
9564Apple-MacBook-Pro-M1pig_latinifygpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_105758__98500.0216749.76791[319, 616]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_105758__985.json56.25missingmissingmissing
9565Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewAsIs1SHOTfalsefalse520231213_204137__84300.0212644.17890[59, 689]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_204137__843.json0.0missingmissingmissing
9566Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewAsIs1SHOTfalsefalse520231225_224845__25600.0170618.61130[59, 549]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_224845__256.json0.0missingmissingmissing
9567Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewAsIs1SHOTfalsefalse520231225_224908__67600.0221323.63220[59, 718]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_224908__676.json0.0missingmissingmissing
9568Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_200604__43900.044.38950[59, 561]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_200604__439.json0.00.1missing0.9
9569Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewInJulia1SHOTtruetrue520231213_204052__84910.021862.03061[62, 706]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_204052__849.json61.25missingmissingmissing
9570Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewInJulia1SHOTtruetrue520231225_224801__70720.0195830.13252[62, 632]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_224801__707.json72.5missingmissingmissing
9571Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewInJulia1SHOTtruefalse520231225_224826__83700.0196725.2310[62, 635]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_224826__837.json25.0missingmissingmissing
9572Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewInJulia1SHOTtruetrue520231227_202938__54130.0234272.14142[62, 760]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_202938__541.json77.5missingmissingmissing
9573Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewInJulia1SHOTtruetrue520231227_203038__77120.0180860.70212[62, 582]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_203038__771.json72.5missingmissingmissing
9574Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_200519__80230.047.43252[62, 548]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_200519__802.json77.50.1missing0.9
9575Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_203950__50820.0112323.62082[97, 342]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_203950__508.json72.5missingmissingmissing
9576Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_224716__39820.0162118.34792[97, 508]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_224716__398.json72.5missingmissingmissing
9577Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_224730__40630.0151614.32862[97, 473]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_224730__406.json77.5missingmissingmissing
9578Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_202755__13720.0129438.00552[97, 399]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_202755__137.json72.5missingmissingmissing
9579Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertAsk1SHOTtruefalse520231227_202825__59200.0126430.36150[97, 389]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_202825__592.json25.0missingmissingmissing
9580Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_200432__57830.037.1412[97, 444]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_200432__578.json77.50.1missing0.9
9581Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_203926__62620.0141856.95172[170, 416]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_203926__626.json72.5missingmissingmissing
9582Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_224640__40330.0172722.16384[170, 519]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_224640__403.json90.0missingmissingmissing
9583Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_224657__98130.0112116.85364[170, 317]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_224657__981.json90.0missingmissingmissing
9584Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_202645__53420.0157425.99312[170, 468]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202645__534.json72.5missingmissingmissing
9585Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231227_202717__92200.0137631.57470[170, 402]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_202717__922.json25.0missingmissingmissing
9586Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_200355__44230.039.27542[170, 512]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_200355__442.json77.50.1missing0.9
9587Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapCoTTask1SHOTtruefalse520231213_204333__74800.0223463.68060[320, 638]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_204333__748.json25.0missingmissingmissing
9588Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_225024__64600.021527.18730[320, 610]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225024__646.json50.0missingmissingmissing
9589Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapCoTTask1SHOTtruefalse520231225_225044__52700.0221919.46330[320, 633]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225044__527.json25.0missingmissingmissing
9590Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_203305__32230.014637.01172[320, 380]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_203305__322.json77.5missingmissingmissing
9591Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_203348__54700.0198242.59881[320, 554]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_203348__547.json56.25missingmissingmissing
9592Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_200727__68500.050.13831[320, 445]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_200727__685.json56.250.1missing0.9
9593Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_204229__40030.0196652.07074[319, 549]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_204229__400.json90.0missingmissingmissing
9594Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_224934__50000.022625.20681[319, 647]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_224934__500.json56.25missingmissingmissing
9595Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_224957__96410.0193622.52971[319, 539]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_224957__964.json61.25missingmissingmissing
9596Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_203125__71630.0217346.43254[319, 618]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_203125__716.json90.0missingmissingmissing
9597Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-previewJuliaRecapTask1SHOTtruefalse520231227_203228__92400.0219462.50660[319, 625]0.10.0-DEV41.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_203228__924.json25.0missingmissingmissing
9598Apple-MacBook-Pro-M1pig_latinifygpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_200637__28300.033.03221[319, 421]0.10.0-DEV41.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_200637__283.json56.250.1missing0.9
9599Apple-MacBook-Pro-M1pig_latinifyllama2AsIs1SHOTfalsefalse520231214_080535__46400.017.94160[53, 532]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__AsIs__1SHOT__20231214_080535__464.json0.0missingmissingmissing
9600Apple-MacBook-Pro-M1pig_latinifyllama2AsIs1SHOTfalsefalse520231225_122529__12000.023.5550[53, 688]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__AsIs__1SHOT__20231225_122529__120.json0.0missing{\n "num_gpu": 99\n}missing
9601Apple-MacBook-Pro-M1pig_latinifyllama2AsIs1SHOTfalsefalse520231225_122545__80800.015.91650[1, 488]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__AsIs__1SHOT__20231225_122545__808.json0.0missing{\n "num_gpu": 99\n}missing
9602Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTfalsefalse520231214_080517__99500.019.0340[70, 557]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231214_080517__995.json0.0missingmissingmissing
9603Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTfalsefalse520231225_122443__73900.016.42810[70, 487]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231225_122443__739.json0.0missing{\n "num_gpu": 99\n}missing
9604Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTtruefalse520231225_122506__94800.022.19890[1, 662]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231225_122506__948.json25.0missing{\n "num_gpu": 99\n}missing
9605Apple-MacBook-Pro-M1pig_latinifyllama2InJulia1SHOTfalsefalse520231227_013748__21300.014.80030[70, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__InJulia__1SHOT__20231227_013748__213.json0.0missing{\n "num_gpu": 99\n}missing
9606Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTtruetrue520231214_080458__47300.016.90590[99, 487]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_080458__473.json50.0missingmissingmissing
9607Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTtruefalse520231225_122416__98300.012.07380[99, 351]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_122416__983.json25.0missing{\n "num_gpu": 99\n}missing
9608Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTfalsefalse520231225_122427__63000.010.91860[1, 338]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_122427__630.json0.0missing{\n "num_gpu": 99\n}missing
9609Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertAsk1SHOTfalsefalse520231227_013733__72700.08.682230[99, 253]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_013733__727.json0.0missing{\n "num_gpu": 99\n}missing
9610Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTtruetrue520231214_080441__51610.019.78831[187, 534]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080441__516.json61.25missingmissingmissing
9611Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTtruetrue520231225_122351__85500.020.23760[205, 407]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122351__855.json50.0missing{\n "num_gpu": 99\n}missing
9612Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTfalsefalse520231225_122404__30200.013.20710[1, 394]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122404__302.json0.0missing{\n "num_gpu": 99\n}missing
9613Apple-MacBook-Pro-M1pig_latinifyllama2JuliaExpertCoTTask1SHOTfalsefalse520231227_013724__81400.025.75460[205, 569]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013724__814.json0.0missing{\n "num_gpu": 99\n}missing
9614Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTtruefalse520231214_080609__77500.014.55550[11, 401]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080609__775.json25.0missingmissingmissing
9615Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTtruefalse520231225_122656__55000.022.83020[11, 615]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122656__550.json25.0missing{\n "num_gpu": 99\n}missing
9616Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTtruetrue520231225_122729__11900.033.07910[1, 866]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_122729__119.json50.0missing{\n "num_gpu": 99\n}missing
9617Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapCoTTask1SHOTfalsefalse520231227_013840__22500.023.44980[11, 637]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013840__225.json0.0missing{\n "num_gpu": 99\n}missing
9618Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231214_080555__92200.019.50640[370, 450]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_080555__922.json0.0missingmissingmissing
9619Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231225_122609__12200.023.91080[370, 565]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_122609__122.json0.0missing{\n "num_gpu": 99\n}missing
9620Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231225_122633__40800.023.42720[1, 636]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_122633__408.json0.0missing{\n "num_gpu": 99\n}missing
9621Apple-MacBook-Pro-M1pig_latinifyllama2JuliaRecapTask1SHOTfalsefalse520231227_013816__87900.028.28760[370, 680]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_013816__879.json0.0missing{\n "num_gpu": 99\n}missing
9622Apple-MacBook-Pro-M1pig_latinifymagicoderAsIs1SHOTfalsefalse520231214_081717__45900.025.24720[53, 728]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__AsIs__1SHOT__20231214_081717__459.json0.0missingmissingmissing
9623Apple-MacBook-Pro-M1pig_latinifymagicoderAsIs1SHOTfalsefalse520231225_131501__75400.010.370[67, 299]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__AsIs__1SHOT__20231225_131501__754.json0.0missing{\n "num_gpu": 99\n}missing
9624Apple-MacBook-Pro-M1pig_latinifymagicoderInJulia1SHOTtruefalse520231214_081652__28600.013.57620[70, 404]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__InJulia__1SHOT__20231214_081652__286.json25.0missingmissingmissing
9625Apple-MacBook-Pro-M1pig_latinifymagicoderInJulia1SHOTtruetrue520231225_125643__92220.011.03572[70, 366]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__InJulia__1SHOT__20231225_125643__922.json72.5missing{\n "num_gpu": 99\n}missing
9626Apple-MacBook-Pro-M1pig_latinifymagicoderInJulia1SHOTtruetrue520231227_015705__64800.010.39782[70, 341]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__InJulia__1SHOT__20231227_015705__648.json62.5missing{\n "num_gpu": 99\n}missing
9627Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTtruetrue520231214_081638__25100.014.52111[99, 420]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_081638__251.json56.25missingmissingmissing
9628Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTfalsefalse520231225_125621__66000.011.09390[109, 353]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_125621__660.json0.0missing{\n "num_gpu": 99\n}missing
9629Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTfalsefalse520231225_125632__40900.010.21770[109, 329]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_125632__409.json0.0missing{\n "num_gpu": 99\n}missing
9630Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertAsk1SHOTfalsefalse520231227_015654__58500.012.65260[109, 408]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_015654__585.json0.0missing{\n "num_gpu": 99\n}missing
9631Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_081623__48500.017.39550[187, 468]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081623__485.json0.0missingmissingmissing
9632Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_125553__63800.023.46370[197, 540]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125553__638.json0.0missing{\n "num_gpu": 99\n}missing
9633Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_125610__35500.017.10990[197, 524]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_125610__355.json0.0missing{\n "num_gpu": 99\n}missing
9634Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_015641__30410.016.30822[197, 330]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_015641__304.json67.5missing{\n "num_gpu": 99\n}missing
9635Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTtruefalse520231214_081805__81200.031.59930[11, 824]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081805__812.json25.0missingmissingmissing
9636Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_131537__63810.015.15121[373, 431]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131537__638.json61.25missing{\n "num_gpu": 99\n}missing
9637Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_131553__80510.015.88871[373, 459]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131553__805.json61.25missing{\n "num_gpu": 99\n}missing
9638Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapCoTTask1SHOTfalsefalse520231227_015727__98200.011.88630[373, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015727__982.json0.0missing{\n "num_gpu": 99\n}missing
9639Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTfalsefalse520231214_081734__96200.016.62550[370, 374]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_081734__962.json0.0missingmissingmissing
9640Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTtruetrue520231225_131513__54600.011.95242[370, 339]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_131513__546.json62.5missing{\n "num_gpu": 99\n}missing
9641Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTfalsefalse520231225_131522__12000.08.581720[370, 219]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_131522__120.json0.0missing{\n "num_gpu": 99\n}missing
9642Apple-MacBook-Pro-M1pig_latinifymagicoderJuliaRecapTask1SHOTtruetrue520231227_015715__17700.010.06991[370, 276]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_015715__177.json56.25missing{\n "num_gpu": 99\n}missing
9643Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_182130__27700.023.73720[70, 447]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182130__277.json25.0missing{\n "num_gpu": 99\n}missing
9644Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_182154__36100.023.95880[70, 460]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182154__361.json25.0missing{\n "num_gpu": 99\n}missing
9645Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KInJulia1SHOTtruefalse520231227_182210__85800.016.29130[70, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182210__858.json25.0missing{\n "num_gpu": 99\n}missing
9646Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182021__26200.021.62230[109, 412]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182021__262.json50.0missing{\n "num_gpu": 99\n}missing
9647Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182046__95500.024.90381[109, 468]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182046__955.json56.25missing{\n "num_gpu": 99\n}missing
9648Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_182106__80000.020.18930[109, 383]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182106__800.json25.0missing{\n "num_gpu": 99\n}missing
9649Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181931__17000.017.60140[197, 305]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181931__170.json25.0missing{\n "num_gpu": 99\n}missing
9650Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_181944__44500.012.67110[197, 223]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181944__445.json25.0missing{\n "num_gpu": 99\n}missing
9651Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_181959__10100.015.09330[197, 271]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_181959__101.json0.0missing{\n "num_gpu": 99\n}missing
9652Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_182337__43400.014.32720[373, 239]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182337__434.json25.0missing{\n "num_gpu": 99\n}missing
9653Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182401__33500.024.20411[373, 410]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182401__335.json56.25missing{\n "num_gpu": 99\n}missing
9654Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_182421__46800.020.03010[373, 348]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182421__468.json0.0missing{\n "num_gpu": 99\n}missing
9655Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_182237__43100.026.84190[370, 472]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182237__431.json25.0missing{\n "num_gpu": 99\n}missing
9656Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182305__30000.027.53921[370, 484]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182305__300.json56.25missing{\n "num_gpu": 99\n}missing
9657Apple-MacBook-Pro-M1pig_latinifymagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182322__76100.016.72661[370, 281]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182322__761.json56.25missing{\n "num_gpu": 99\n}missing
9658Apple-MacBook-Pro-M1pig_latinifymistral-mediumAsIs1SHOTfalsefalse520231213_204616__49300.0045845518.56070[65, 545]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__AsIs__1SHOT__20231213_204616__493.json0.0missingmissingmissing
9659Apple-MacBook-Pro-M1pig_latinifymistral-mediumAsIs1SHOTfalsefalse520231225_225431__52800.0038564510.11850[65, 455]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__AsIs__1SHOT__20231225_225431__528.json0.0missingmissingmissing
9660Apple-MacBook-Pro-M1pig_latinifymistral-mediumAsIs1SHOTfalsefalse520231225_225449__90300.0066070517.80450[65, 795]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__AsIs__1SHOT__20231225_225449__903.json0.0missingmissingmissing
9661Apple-MacBook-Pro-M1pig_latinifymistral-medium--optimAsIs1SHOTfalsefalse520231215_200924__45900.010.96890[65, 501]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__AsIs__1SHOT__20231215_200924__459.json0.00.9missing0.3
9662Apple-MacBook-Pro-M1pig_latinifymistral-mediumInJulia1SHOTtruefalse520231213_204557__52100.0040182610.48870[68, 474]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__InJulia__1SHOT__20231213_204557__521.json25.0missingmissingmissing
9663Apple-MacBook-Pro-M1pig_latinifymistral-mediumInJulia1SHOTtruefalse520231225_225409__26300.00374329.793940[68, 440]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__InJulia__1SHOT__20231225_225409__263.json25.0missingmissingmissing
9664Apple-MacBook-Pro-M1pig_latinifymistral-mediumInJulia1SHOTtruefalse520231225_225421__61100.0042609611.22110[68, 504]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__InJulia__1SHOT__20231225_225421__611.json25.0missingmissingmissing
9665Apple-MacBook-Pro-M1pig_latinifymistral-mediumInJulia1SHOTtruefalse520231227_204300__94800.0040506210.67130[68, 478]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__InJulia__1SHOT__20231227_204300__948.json25.0missingmissingmissing
9666Apple-MacBook-Pro-M1pig_latinifymistral-mediumInJulia1SHOTtruefalse520231227_204316__82800.0052883916.10650[68, 631]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__InJulia__1SHOT__20231227_204316__828.json25.0missingmissingmissing
9667Apple-MacBook-Pro-M1pig_latinifymistral-medium--optimInJulia1SHOTtruefalse520231215_200913__80300.011.9950[68, 547]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__InJulia__1SHOT__20231215_200913__803.json25.00.9missing0.3
9668Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_204547__91410.0047545812.33231[107, 552]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_204547__914.json61.25missingmissingmissing
9669Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertAsk1SHOTfalsefalse520231225_225352__17000.003719069.479960[107, 424]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_225352__170.json0.0missingmissingmissing
9670Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_225359__42600.002788716.947260[107, 309]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_225359__426.json25.0missingmissingmissing
9671Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_203634__32600.0035491714.8410[107, 403]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_203634__326.json25.0missingmissingmissing
9672Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_204249__87400.0035087214.95990[107, 398]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_204249__874.json25.0missingmissingmissing
9673Apple-MacBook-Pro-M1pig_latinifymistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_200901__94820.07.51992[107, 342]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_200901__948.json72.50.9missing0.3
9674Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231213_204534__35000.0050973525.82240[195, 565]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_204534__350.json25.0missingmissingmissing
9675Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231225_225331__37000.0039162117.04780[195, 419]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225331__370.json25.0missingmissingmissing
9676Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_225342__53210.0046604911.48111[195, 511]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225342__532.json61.25missingmissingmissing
9677Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_203605__57700.0046119511.91850[195, 505]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_203605__577.json25.0missingmissingmissing
9678Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_203619__74220.005380513.78062[195, 600]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_203619__742.json72.5missingmissingmissing
9679Apple-MacBook-Pro-M1pig_latinifymistral-medium--optimJuliaExpertCoTTask1SHOTtruefalse520231215_200853__11000.013.71550[195, 482]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_200853__110.json25.00.9missing0.3
9680Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231213_204723__21200.0045424227.99670[370, 438]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_204723__212.json25.0missingmissingmissing
9681Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_225616__66000.0065406532.71620[370, 685]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225616__660.json25.0missingmissingmissing
9682Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_225642__76300.0047770326.47490[370, 467]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225642__763.json25.0missingmissingmissing
9683Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231227_204352__18200.0055941213.00540[370, 568]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204352__182.json25.0missingmissingmissing
9684Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231227_204403__13100.0049145611.08840[370, 484]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204403__131.json25.0missingmissingmissing
9685Apple-MacBook-Pro-M1pig_latinifymistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_201015__54100.030.08050[370, 605]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201015__541.json50.00.9missing0.3
9686Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapTask1SHOTtruefalse520231213_204654__42200.0079159438.08560[367, 856]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_204654__422.json25.0missingmissingmissing
9687Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapTask1SHOTfalsefalse520231225_225514__86200.0050925325.44040[367, 507]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_225514__862.json0.0missingmissingmissing
9688Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapTask1SHOTtruefalse520231225_225543__32400.0060309728.49970[367, 623]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_225543__324.json25.0missingmissingmissing
9689Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapTask1SHOTtruefalse520231227_204327__11700.0050035411.39390[367, 496]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_204327__117.json25.0missingmissingmissing
9690Apple-MacBook-Pro-M1pig_latinifymistral-mediumJuliaRecapTask1SHOTtruefalse520231227_204339__47300.0048983711.08770[367, 483]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_204339__473.json25.0missingmissingmissing
9691Apple-MacBook-Pro-M1pig_latinifymistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_200944__87030.019.93364[367, 421]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_200944__870.json90.00.9missing0.3
9692Apple-MacBook-Pro-M1pig_latinifymistral-smallAsIs1SHOTfalsefalse520231213_204454__28200.0007760216.862130[63, 379]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__AsIs__1SHOT__20231213_204454__282.json0.0missingmissingmissing
9693Apple-MacBook-Pro-M1pig_latinifymistral-smallAsIs1SHOTfalsefalse520231225_225233__60300.0011640212.26250[63, 579]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__AsIs__1SHOT__20231225_225233__603.json0.0missingmissingmissing
9694Apple-MacBook-Pro-M1pig_latinifymistral-smallAsIs1SHOTfalsefalse520231225_225239__15500.0009215216.152110[63, 454]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__AsIs__1SHOT__20231225_225239__155.json0.0missingmissingmissing
9695Apple-MacBook-Pro-M1pig_latinifymistral-small--optimAsIs1SHOTfalsefalse520231215_200824__63100.06.64350[63, 509]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__AsIs__1SHOT__20231215_200824__631.json0.00.9missing0.3
9696Apple-MacBook-Pro-M1pig_latinifymistral-smallInJulia1SHOTtruefalse520231213_204447__35800.001154327.644290[66, 573]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__InJulia__1SHOT__20231213_204447__358.json25.0missingmissingmissing
9697Apple-MacBook-Pro-M1pig_latinifymistral-smallInJulia1SHOTtruefalse520231225_225214__80200.0008284025.576960[66, 405]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__InJulia__1SHOT__20231225_225214__802.json25.0missingmissingmissing
9698Apple-MacBook-Pro-M1pig_latinifymistral-smallInJulia1SHOTtruefalse520231225_225220__91700.0008264625.684460[66, 404]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__InJulia__1SHOT__20231225_225220__917.json25.0missingmissingmissing
9699Apple-MacBook-Pro-M1pig_latinifymistral-smallInJulia1SHOTtruefalse520231227_203514__94700.0009292826.214210[66, 457]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__InJulia__1SHOT__20231227_203514__947.json25.0missingmissingmissing
9700Apple-MacBook-Pro-M1pig_latinifymistral-smallInJulia1SHOTtruefalse520231227_203520__98400.0008342225.456530[66, 408]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__InJulia__1SHOT__20231227_203520__984.json25.0missingmissingmissing
9701Apple-MacBook-Pro-M1pig_latinifymistral-small--optimInJulia1SHOTtruefalse520231215_200817__18300.05.37930[66, 404]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__InJulia__1SHOT__20231215_200817__183.json25.00.9missing0.3
9702Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertAsk1SHOTtruefalse520231213_204439__68700.0006318293.968520[107, 290]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_204439__687.json25.0missingmissingmissing
9703Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertAsk1SHOTtruefalse520231225_225206__67500.0006085493.789350[107, 278]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_225206__675.json25.0missingmissingmissing
9704Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertAsk1SHOTtruefalse520231225_225209__91000.0004494692.757040[107, 196]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_225209__910.json25.0missingmissingmissing
9705Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertAsk1SHOTtruefalse520231227_203502__63800.0007734494.903220[107, 363]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_203502__638.json25.0missingmissingmissing
9706Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertAsk1SHOTtruefalse520231227_203507__46900.0007579294.819550[107, 355]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_203507__469.json25.0missingmissingmissing
9707Apple-MacBook-Pro-M1pig_latinifymistral-small--optimJuliaExpertAsk1SHOTtruefalse520231215_200812__32900.05.702870[107, 426]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_200812__329.json25.00.9missing0.3
9708Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertCoTTask1SHOTtruefalse520231213_204434__39000.001036036.319870[195, 469]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_204434__390.json25.0missingmissingmissing
9709Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_225155__92400.001212568.970730[195, 560]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225155__924.json50.0missingmissingmissing
9710Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertCoTTask1SHOTtruefalse520231225_225202__64500.0009681256.410570[195, 434]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225202__645.json25.0missingmissingmissing
9711Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231227_203450__52800.0003647851.926740[195, 123]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_203450__528.json0.0missingmissingmissing
9712Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaExpertCoTTask1SHOTtruefalse520231227_203457__18800.001239727.662280[195, 574]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_203457__188.json25.0missingmissingmissing
9713Apple-MacBook-Pro-M1pig_latinifymistral-small--optimJuliaExpertCoTTask1SHOTtruefalse520231215_200806__20500.06.034430[195, 450]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_200806__205.json25.00.9missing0.3
9714Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_204508__25910.001316097.535381[373, 554]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_204508__259.json61.25missingmissingmissing
9715Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapCoTTask1SHOTfalsefalse520231225_225305__79900.001630379.803620[373, 716]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225305__799.json0.0missingmissingmissing
9716Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapCoTTask1SHOTtruefalse520231225_225313__75700.001440258.539090[373, 618]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225313__757.json25.0missingmissingmissing
9717Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_203545__66810.001178356.882491[373, 483]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_203545__668.json61.25missingmissingmissing
9718Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapCoTTask1SHOTtruefalse520231227_203553__47000.001354897.777470[373, 574]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_203553__470.json25.0missingmissingmissing
9719Apple-MacBook-Pro-M1pig_latinifymistral-small--optimJuliaRecapCoTTask1SHOTtruefalse520231215_200839__59300.07.425820[373, 517]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_200839__593.json25.00.9missing0.3
9720Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapTask1SHOTfalsefalse520231213_204501__77100.001250787.018240[371, 521]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_204501__771.json0.0missingmissingmissing
9721Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapTask1SHOTtruefalse520231225_225247__10600.00138278.064750[371, 589]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_225247__106.json25.0missingmissingmissing
9722Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapTask1SHOTtruefalse520231225_225254__46900.001241087.058220[371, 516]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_225254__469.json25.0missingmissingmissing
9723Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapTask1SHOTtruetrue520231227_203527__72610.00128577.251341[371, 539]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_203527__726.json61.25missingmissingmissing
9724Apple-MacBook-Pro-M1pig_latinifymistral-smallJuliaRecapTask1SHOTtruetrue520231227_203537__85410.0014835810.17151[371, 641]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_203537__854.json61.25missingmissingmissing
9725Apple-MacBook-Pro-M1pig_latinifymistral-small--optimJuliaRecapTask1SHOTtruefalse520231215_200831__27200.06.835460[371, 504]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_200831__272.json25.00.9missing0.3
9726Apple-MacBook-Pro-M1pig_latinifymistral-tinyAsIs1SHOTfalsefalse520231213_204404__59300.00027790210.15060[63, 594]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__AsIs__1SHOT__20231213_204404__593.json0.0missingmissingmissing
9727Apple-MacBook-Pro-M1pig_latinifymistral-tinyAsIs1SHOTfalsefalse520231225_225119__13000.000325925.941260[63, 700]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__AsIs__1SHOT__20231225_225119__130.json0.0missingmissingmissing
9728Apple-MacBook-Pro-M1pig_latinifymistral-tinyAsIs1SHOTfalsefalse520231225_225124__80800.0002774495.020880[63, 593]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__AsIs__1SHOT__20231225_225124__808.json0.0missingmissingmissing
9729Apple-MacBook-Pro-M1pig_latinifymistral-tiny--optimAsIs1SHOTfalsefalse520231215_200748__81900.06.851540[63, 835]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__AsIs__1SHOT__20231215_200748__819.json0.00.9missing0.3
9730Apple-MacBook-Pro-M1pig_latinifymistral-tinyInJulia1SHOTtruefalse520231213_204354__29700.0002094665.892530[66, 442]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__InJulia__1SHOT__20231213_204354__297.json25.0missingmissingmissing
9731Apple-MacBook-Pro-M1pig_latinifymistral-tinyInJulia1SHOTtruetrue520231225_225106__73900.0002081073.830360[66, 439]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__InJulia__1SHOT__20231225_225106__739.json50.0missingmissingmissing
9732Apple-MacBook-Pro-M1pig_latinifymistral-tinyInJulia1SHOTtruetrue520231225_225113__46900.0003485376.270240[66, 749]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__InJulia__1SHOT__20231225_225113__469.json50.0missingmissingmissing
9733Apple-MacBook-Pro-M1pig_latinifymistral-tinyInJulia1SHOTtruefalse520231227_203416__47900.0002398174.555960[66, 509]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__InJulia__1SHOT__20231227_203416__479.json25.0missingmissingmissing
9734Apple-MacBook-Pro-M1pig_latinifymistral-tinyInJulia1SHOTtruetrue520231227_203422__93010.0003109385.962221[66, 666]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__InJulia__1SHOT__20231227_203422__930.json61.25missingmissingmissing
9735Apple-MacBook-Pro-M1pig_latinifymistral-tiny--optimInJulia1SHOTtruefalse520231215_200741__19400.03.179310[66, 381]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__InJulia__1SHOT__20231215_200741__194.json25.00.9missing0.3
9736Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertAsk1SHOTtruefalse520231213_204348__90300.0002405748.1930[107, 498]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_204348__903.json25.0missingmissingmissing
9737Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_225100__16200.0001930093.4090[107, 393]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_225100__162.json0.0missingmissingmissing
9738Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertAsk1SHOTtruefalse520231225_225103__37000.0001531452.679910[107, 305]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_225103__370.json25.0missingmissingmissing
9739Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertAsk1SHOTfalsefalse520231227_203407__22900.0001794193.311140[107, 363]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_203407__229.json0.0missingmissingmissing
9740Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertAsk1SHOTtruefalse520231227_203411__89400.0002242664.12790[107, 462]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_203411__894.json25.0missingmissingmissing
9741Apple-MacBook-Pro-M1pig_latinifymistral-tiny--optimJuliaExpertAsk1SHOTtruefalse520231215_200737__46000.04.233130[107, 504]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_200737__460.json25.00.9missing0.3
9742Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231213_204340__23100.0002284326.057720[195, 444]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_204340__231.json25.0missingmissingmissing
9743Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231225_225053__32400.000235688.711540[195, 460]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225053__324.json25.0missingmissingmissing
9744Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_225056__79700.0002107653.571130[195, 405]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225056__797.json0.0missingmissingmissing
9745Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_203359__29700.00026240710.54470[195, 519]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_203359__297.json50.0missingmissingmissing
9746Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231227_203404__76300.0002669374.760940[195, 529]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_203404__763.json0.0missingmissingmissing
9747Apple-MacBook-Pro-M1pig_latinifymistral-tiny--optimJuliaExpertCoTTask1SHOTtruefalse520231215_200733__86700.06.01380[195, 478]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_200733__867.json25.00.9missing0.3
9748Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_204428__57600.00033715710.76310[373, 629]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_204428__576.json50.0missingmissingmissing
9749Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_225140__84500.0003072594.874070[373, 563]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225140__845.json50.0missingmissingmissing
9750Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_225146__82300.0003611665.908050[373, 682]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225146__823.json50.0missingmissingmissing
9751Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_203440__31800.0002936694.919550[373, 533]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_203440__318.json50.0missingmissingmissing
9752Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_203447__18610.000423687.591771[373, 820]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_203447__186.json61.25missingmissingmissing
9753Apple-MacBook-Pro-M1pig_latinifymistral-tiny--optimJuliaRecapCoTTask1SHOTtruefalse520231215_200800__70000.05.154250[373, 609]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_200800__700.json25.00.9missing0.3
9754Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapTask1SHOTtruefalse520231213_204417__76200.00035816812.69240[371, 676]0.10.0-DEV41.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_204417__762.json25.0missingmissingmissing
9755Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapTask1SHOTtruetrue520231225_225129__65810.0003305355.353134[371, 615]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_225129__658.json80.0missingmissingmissing
9756Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapTask1SHOTtruefalse520231225_225135__21000.0003309885.374870[371, 616]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_225135__210.json25.0missingmissingmissing
9757Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapTask1SHOTtruefalse520231227_203428__85500.0003346125.805770[371, 624]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_203428__855.json25.0missingmissingmissing
9758Apple-MacBook-Pro-M1pig_latinifymistral-tinyJuliaRecapTask1SHOTtruefalse520231227_203435__94700.0003676816.499380[371, 697]0.10.0-DEV41.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_203435__947.json25.0missingmissingmissing
9759Apple-MacBook-Pro-M1pig_latinifymistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_200754__47600.06.64310[371, 783]0.10.0-DEV41.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_200754__476.json50.00.9missing0.3
9760Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_135605__73200.013.74960[62, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_135605__732.json0.0missing{\n "num_gpu": 99\n}missing
9761Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_135622__61000.016.82490[62, 429]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_135622__610.json0.0missing{\n "num_gpu": 99\n}missing
9762Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_135534__37400.018.15490[65, 460]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_135534__374.json0.0missing{\n "num_gpu": 99\n}missing
9763Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_135551__31600.016.8741[65, 427]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_135551__316.json56.25missing{\n "num_gpu": 99\n}missing
9764Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231227_021310__57300.015.0780[65, 379]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_021310__573.json25.0missing{\n "num_gpu": 99\n}missing
9765Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_135509__91100.014.7180[106, 366]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135509__911.json25.0missing{\n "num_gpu": 99\n}missing
9766Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_135516__61600.06.839430[106, 162]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135516__616.json25.0missing{\n "num_gpu": 99\n}missing
9767Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_021255__32900.013.26680[106, 327]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_021255__329.json25.0missing{\n "num_gpu": 99\n}missing
9768Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_135439__51500.025.78980[194, 488]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135439__515.json25.0missing{\n "num_gpu": 99\n}missing
9769Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_135454__67900.014.98560[194, 357]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135454__679.json0.0missing{\n "num_gpu": 99\n}missing
9770Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_021242__98910.019.61221[194, 337]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021242__989.json61.25missing{\n "num_gpu": 99\n}missing
9771Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_135825__87000.083.53420[373, 1876]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135825__870.json25.0missing{\n "num_gpu": 99\n}missing
9772Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_135849__29400.024.16580[373, 555]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135849__294.json25.0missing{\n "num_gpu": 99\n}missing
9773Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_021349__19000.017.8560[373, 398]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021349__190.json25.0missing{\n "num_gpu": 99\n}missing
9774Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_135641__28600.019.45960[371, 440]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135641__286.json50.0missing{\n "num_gpu": 99\n}missing
9775Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_135701__64600.019.98010[371, 453]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135701__646.json0.0missing{\n "num_gpu": 99\n}missing
9776Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_021331__32400.020.77260[371, 469]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_021331__324.json0.0missing{\n "num_gpu": 99\n}missing
9777Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_001149__80300.019.74860[64, 628]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001149__803.json50.0missing{\n "num_gpu": 99\n}missing
9778Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_001205__44700.015.5010[64, 496]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001205__447.json25.0missing{\n "num_gpu": 99\n}missing
9779Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_001219__96700.014.24620[64, 456]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001219__967.json25.0missing{\n "num_gpu": 99\n}missing
9780Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_001238__60700.019.27410[64, 614]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001238__607.json50.0missing{\n "num_gpu": 99\n}missing
9781Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_001255__37000.016.53980[64, 529]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_001255__370.json25.0missing{\n "num_gpu": 99\n}missing
9782Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001031__37600.015.6960[105, 490]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001031__376.json25.0missing{\n "num_gpu": 99\n}missing
9783Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001044__58200.012.60110[105, 393]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001044__582.json25.0missing{\n "num_gpu": 99\n}missing
9784Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001056__59400.012.06630[105, 376]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001056__594.json25.0missing{\n "num_gpu": 99\n}missing
9785Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse520231228_001111__81300.015.13730[105, 473]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001111__813.json25.0missing{\n "num_gpu": 99\n}missing
9786Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_001129__31900.017.99750[105, 562]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_001129__319.json50.0missing{\n "num_gpu": 99\n}missing
9787Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_000902__34000.020.9610[193, 615]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000902__340.json25.0missing{\n "num_gpu": 99\n}missing
9788Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_000924__70500.022.19560[193, 672]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000924__705.json0.0missing{\n "num_gpu": 99\n}missing
9789Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_000946__31800.021.73890[193, 657]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_000946__318.json25.0missing{\n "num_gpu": 99\n}missing
9790Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_001003__89900.016.56970[193, 499]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001003__899.json0.0missing{\n "num_gpu": 99\n}missing
9791Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_001016__15400.012.78730[193, 381]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001016__154.json25.0missing{\n "num_gpu": 99\n}missing
9792Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_001448__23700.014.32680[372, 396]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001448__237.json0.0missing{\n "num_gpu": 99\n}missing
9793Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_001511__99600.022.97150[372, 656]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001511__996.json25.0missing{\n "num_gpu": 99\n}missing
9794Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_001537__80400.025.87780[372, 740]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001537__804.json0.0missing{\n "num_gpu": 99\n}missing
9795Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_001558__80000.020.92810[372, 596]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001558__800.json0.0missing{\n "num_gpu": 99\n}missing
9796Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_001614__88600.016.35260[372, 458]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_001614__886.json25.0missing{\n "num_gpu": 99\n}missing
9797Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_001314__59800.019.4980[370, 553]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001314__598.json50.0missing{\n "num_gpu": 99\n}missing
9798Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_001333__49900.019.12430[370, 542]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001333__499.json50.0missing{\n "num_gpu": 99\n}missing
9799Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse520231228_001355__54800.021.90580[370, 624]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001355__548.json25.0missing{\n "num_gpu": 99\n}missing
9800Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_001415__47900.019.29520[370, 547]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001415__479.json50.0missing{\n "num_gpu": 99\n}missing
9801Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_001434__51800.018.77470[370, 531]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_001434__518.json50.0missing{\n "num_gpu": 99\n}missing
9802Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_001946__32410.022.06751[64, 557]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_001946__324.json61.25missing{\n "num_gpu": 99\n}missing
9803Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231228_002010__14300.023.36970[64, 589]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002010__143.json25.0missing{\n "num_gpu": 99\n}missing
9804Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231228_002030__93000.020.23470[64, 511]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002030__930.json25.0missing{\n "num_gpu": 99\n}missing
9805Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231228_002053__49700.022.79490[64, 575]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002053__497.json25.0missing{\n "num_gpu": 99\n}missing
9806Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_002109__52700.015.61460[64, 395]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_002109__527.json0.0missing{\n "num_gpu": 99\n}missing
9807Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231228_001817__77400.013.25220[105, 325]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001817__774.json25.0missing{\n "num_gpu": 99\n}missing
9808Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_001840__60200.022.62480[105, 560]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001840__602.json50.0missing{\n "num_gpu": 99\n}missing
9809Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231228_001855__81500.015.37980[105, 379]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001855__815.json25.0missing{\n "num_gpu": 99\n}missing
9810Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse520231228_001909__70700.013.66250[105, 336]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001909__707.json25.0missing{\n "num_gpu": 99\n}missing
9811Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231228_001924__73000.014.93440[105, 368]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_001924__730.json0.0missing{\n "num_gpu": 99\n}missing
9812Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_001634__25100.019.50120[193, 446]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001634__251.json25.0missing{\n "num_gpu": 99\n}missing
9813Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_001653__15300.019.16430[193, 458]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001653__153.json25.0missing{\n "num_gpu": 99\n}missing
9814Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_001718__75700.024.62620[193, 592]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001718__757.json0.0missing{\n "num_gpu": 99\n}missing
9815Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_001738__49200.020.26830[193, 485]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001738__492.json25.0missing{\n "num_gpu": 99\n}missing
9816Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_001804__97300.025.82560[193, 621]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_001804__973.json25.0missing{\n "num_gpu": 99\n}missing
9817Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_002329__77600.021.66450[372, 489]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002329__776.json50.0missing{\n "num_gpu": 99\n}missing
9818Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231228_002357__92200.027.19320[372, 621]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002357__922.json0.0missing{\n "num_gpu": 99\n}missing
9819Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_002425__73400.028.78980[372, 659]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002425__734.json25.0missing{\n "num_gpu": 99\n}missing
9820Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231228_002449__19400.023.12920[372, 524]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002449__194.json0.0missing{\n "num_gpu": 99\n}missing
9821Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_002512__71800.022.9440[372, 520]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_002512__718.json25.0missing{\n "num_gpu": 99\n}missing
9822Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_002140__99400.030.6170[370, 702]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002140__994.json25.0missing{\n "num_gpu": 99\n}missing
9823Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_002157__99100.016.94060[370, 374]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002157__991.json25.0missing{\n "num_gpu": 99\n}missing
9824Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_002213__10000.015.52560[370, 339]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002213__100.json25.0missing{\n "num_gpu": 99\n}missing
9825Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_002245__62500.032.07720[370, 736]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002245__625.json25.0missing{\n "num_gpu": 99\n}missing
9826Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_002307__43800.021.96010[370, 496]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_002307__438.json0.0missing{\n "num_gpu": 99\n}missing
9827Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_123307__13600.037.42160[61, 693]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_123307__136.json0.0missing{\n "num_gpu": 99\n}missing
9828Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_123332__38100.024.7640[61, 460]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_123332__381.json0.0missing{\n "num_gpu": 99\n}missing
9829Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_123157__29700.026.94980[64, 501]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123157__297.json25.0missing{\n "num_gpu": 99\n}missing
9830Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_123230__39300.032.32070[64, 600]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123230__393.json25.0missing{\n "num_gpu": 99\n}missing
9831Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_021814__97200.030.78790[64, 570]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_021814__972.json50.0missing{\n "num_gpu": 99\n}missing
9832Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231226_123106__25600.021.1950[105, 386]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123106__256.json0.0missing{\n "num_gpu": 99\n}missing
9833Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse520231226_123131__56400.024.33660[105, 445]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123131__564.json25.0missing{\n "num_gpu": 99\n}missing
9834Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_021743__18300.018.57460[105, 337]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_021743__183.json0.0missing{\n "num_gpu": 99\n}missing
9835Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_123014__70600.032.92570[193, 589]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123014__706.json0.0missing{\n "num_gpu": 99\n}missing
9836Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_123045__78500.030.65550[193, 547]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123045__785.json50.0missing{\n "num_gpu": 99\n}missing
9837Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_021724__35200.036.50970[193, 490]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021724__352.json25.0missing{\n "num_gpu": 99\n}missing
9838Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231226_123508__17400.029.18170[372, 488]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_123508__174.json0.0missing{\n "num_gpu": 99\n}missing
9839Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_123539__94700.031.00880[372, 518]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_123539__947.json25.0missing{\n "num_gpu": 99\n}missing
9840Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_021926__50400.030.96670[372, 528]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021926__504.json0.0missing{\n "num_gpu": 99\n}missing
9841Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse520231226_123402__75900.029.66850[370, 505]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123402__759.json25.0missing{\n "num_gpu": 99\n}missing
9842Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_123438__75630.036.24934[370, 616]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123438__756.json90.0missing{\n "num_gpu": 99\n}missing
9843Apple-MacBook-Pro-M1pig_latinifymistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_021855__26200.041.64730[370, 717]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_021855__262.json0.0missing{\n "num_gpu": 99\n}missing
9844Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse520231227_124453__65400.069.68560[69, 414]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_124453__654.json0.0missing{\n "num_gpu": 99\n}missing
9845Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_124546__29000.052.64540[69, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_124546__290.json25.0missing{\n "num_gpu": 99\n}missing
9846Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_124702__36110.076.01054[69, 452]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_124702__361.json80.0missing{\n "num_gpu": 99\n}missing
9847Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_154522__74900.0104.3590[69, 617]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_154522__749.json50.0missing{\n "num_gpu": 99\n}missing
9848Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse520231227_154603__72800.040.10940[69, 233]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_154603__728.json0.0missing{\n "num_gpu": 99\n}missing
9849Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_124139__67720.062.41772[108, 364]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_124139__677.json72.5missing{\n "num_gpu": 99\n}missing
9850Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_124323__32100.0103.7640[108, 610]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_124323__321.json0.0missing{\n "num_gpu": 99\n}missing
9851Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_124343__71000.019.9450[108, 105]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_124343__710.json0.0missing{\n "num_gpu": 99\n}missing
9852Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_154212__81000.057.09330[108, 330]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_154212__810.json0.0missing{\n "num_gpu": 99\n}missing
9853Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_154337__46500.085.60780[108, 500]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_154337__465.json25.0missing{\n "num_gpu": 99\n}missing
9854Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_123845__73500.086.7480[197, 461]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123845__735.json25.0missing{\n "num_gpu": 99\n}missing
9855Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_123943__70110.056.31931[197, 311]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_123943__701.json61.25missing{\n "num_gpu": 99\n}missing
9856Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_124037__84200.053.66940[197, 295]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_124037__842.json50.0missing{\n "num_gpu": 99\n}missing
9857Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_153945__79610.081.15451[197, 456]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_153945__796.json61.25missing{\n "num_gpu": 99\n}missing
9858Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_154114__22700.088.1790[197, 497]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_154114__227.json25.0missing{\n "num_gpu": 99\n}missing
9859Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_125408__28500.067.00150[382, 324]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125408__285.json50.0missing{\n "num_gpu": 99\n}missing
9860Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_125419__35800.010.6760[382, 5]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125419__358.json0.0missing{\n "num_gpu": 99\n}missing
9861Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_125614__56600.0114.8572[382, 587]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125614__566.json62.5missing{\n "num_gpu": 99\n}missing
9862Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_154818__63400.010.58080[382, 5]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_154818__634.json0.0missing{\n "num_gpu": 99\n}missing
9863Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_125118__28000.0106.00[380, 566]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_125118__280.json50.0missing{\n "num_gpu": 99\n}missing
9864Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_125301__20300.0102.4010[380, 522]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_125301__203.json50.0missing{\n "num_gpu": 99\n}missing
9865Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_154703__26000.060.80681[380, 304]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_154703__260.json56.25missing{\n "num_gpu": 99\n}missing
9866Apple-MacBook-Pro-M1pig_latinifynous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_154807__99500.063.51090[380, 320]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_154807__995.json0.0missing{\n "num_gpu": 99\n}missing
9867Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_140101__53500.019.24210[70, 486]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_140101__535.json0.0missing{\n "num_gpu": 99\n}missing
9868Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_140114__65400.012.91180[70, 325]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_140114__654.json0.0missing{\n "num_gpu": 99\n}missing
9869Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231225_140027__75100.014.78990[73, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_140027__751.json25.0missing{\n "num_gpu": 99\n}missing
9870Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231225_140041__55500.013.64650[73, 343]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_140041__555.json25.0missing{\n "num_gpu": 99\n}missing
9871Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruefalse520231227_021444__54900.016.4250[73, 412]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_021444__549.json25.0missing{\n "num_gpu": 99\n}missing
9872Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_135953__69100.022.01850[114, 549]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135953__691.json25.0missing{\n "num_gpu": 99\n}missing
9873Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_140012__16010.019.06622[114, 475]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_140012__160.json67.5missing{\n "num_gpu": 99\n}missing
9874Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruefalse520231227_021427__57100.011.9420[114, 292]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_021427__571.json25.0missing{\n "num_gpu": 99\n}missing
9875Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_135913__29000.024.0360[202, 424]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135913__290.json25.0missing{\n "num_gpu": 99\n}missing
9876Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_135931__84800.017.86210[202, 428]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_135931__848.json25.0missing{\n "num_gpu": 99\n}missing
9877Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_021415__57300.025.20610[202, 461]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021415__573.json25.0missing{\n "num_gpu": 99\n}missing
9878Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_140214__72400.016.71070[381, 371]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140214__724.json0.0missing{\n "num_gpu": 99\n}missing
9879Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_140239__17500.024.92710[381, 571]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140239__175.json25.0missing{\n "num_gpu": 99\n}missing
9880Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231227_021530__14100.022.71080[381, 515]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021530__141.json25.0missing{\n "num_gpu": 99\n}missing
9881Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_140137__27000.023.83170[379, 545]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_140137__270.json0.0missing{\n "num_gpu": 99\n}missing
9882Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruefalse520231225_140157__20500.020.08220[379, 454]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_140157__205.json25.0missing{\n "num_gpu": 99\n}missing
9883Apple-MacBook-Pro-M1pig_latinifyopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_021507__78300.023.07780[379, 524]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_021507__783.json0.0missing{\n "num_gpu": 99\n}missing
9884Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_080723__82200.017.60780[53, 523]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_080723__822.json0.0missingmissingmissing
9885Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_122850__51800.011.04920[68, 358]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_122850__518.json0.0missing{\n "num_gpu": 99\n}missing
9886Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_122902__94200.011.69890[68, 379]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_122902__942.json0.0missing{\n "num_gpu": 99\n}missing
9887Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTfalsefalse520231214_080705__43400.017.76450[70, 523]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_080705__434.json0.0missingmissingmissing
9888Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231225_122830__43100.09.952010[71, 322]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_122830__431.json25.0missing{\n "num_gpu": 99\n}missing
9889Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231225_122839__51900.09.125280[71, 294]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_122839__519.json25.0missing{\n "num_gpu": 99\n}missing
9890Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralInJulia1SHOTtruefalse520231227_013921__81200.014.51490[71, 468]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_013921__812.json25.0missing{\n "num_gpu": 99\n}missing
9891Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231214_080648__30200.013.73550[99, 398]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_080648__302.json25.0missingmissingmissing
9892Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_122810__42200.08.843152[112, 279]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_122810__422.json62.5missing{\n "num_gpu": 99\n}missing
9893Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruefalse520231225_122820__16100.09.991830[112, 316]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_122820__161.json25.0missing{\n "num_gpu": 99\n}missing
9894Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_013906__63410.010.10382[112, 318]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_013906__634.json67.5missing{\n "num_gpu": 99\n}missing
9895Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231214_080634__52500.024.53010[187, 659]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080634__525.json0.0missingmissingmissing
9896Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_122749__68300.020.4690[200, 470]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122749__683.json50.0missing{\n "num_gpu": 99\n}missing
9897Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231225_122801__71600.011.35890[200, 344]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_122801__716.json0.0missing{\n "num_gpu": 99\n}missing
9898Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse520231227_013856__30700.016.0510[200, 334]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_013856__307.json0.0missing{\n "num_gpu": 99\n}missing
9899Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231214_080820__64000.029.2160[11, 767]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_080820__640.json0.0missingmissingmissing
9900Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_123004__55400.018.6950[379, 540]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123004__554.json25.0missing{\n "num_gpu": 99\n}missing
9901Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231225_123021__57900.016.46390[379, 472]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123021__579.json25.0missing{\n "num_gpu": 99\n}missing
9902Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_013953__80200.011.59380[379, 318]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_013953__802.json50.0missing{\n "num_gpu": 99\n}missing
9903Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231214_080750__53400.027.28550[370, 646]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_080750__534.json0.0missingmissingmissing
9904Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_122920__42500.018.24730[377, 527]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_122920__425.json50.0missing{\n "num_gpu": 99\n}missing
9905Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_122946__95400.025.39820[377, 742]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_122946__954.json25.0missing{\n "num_gpu": 99\n}missing
9906Apple-MacBook-Pro-M1pig_latinifyopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_013941__39300.020.55090[377, 593]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_013941__393.json50.0missing{\n "num_gpu": 99\n}missing
9907Apple-MacBook-Pro-M1pig_latinifyorca2:13bAsIs1SHOTfalsefalse520231214_082108__98000.012.44040[53, 376]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__AsIs__1SHOT__20231214_082108__980.json0.0missingmissingmissing
9908Apple-MacBook-Pro-M1pig_latinifyorca2:13bAsIs1SHOTfalsefalse520231225_132035__25500.013.39190[70, 241]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__AsIs__1SHOT__20231225_132035__255.json0.0missing{\n "num_gpu": 99\n}missing
9909Apple-MacBook-Pro-M1pig_latinifyorca2:13bAsIs1SHOTfalsefalse520231225_132038__62200.03.225460[70, 47]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__AsIs__1SHOT__20231225_132038__622.json0.0missing{\n "num_gpu": 99\n}missing
9910Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTtruefalse520231214_082056__32200.013.80150[70, 410]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231214_082056__322.json25.0missingmissingmissing
9911Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231225_132003__53200.06.437520[73, 109]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231225_132003__532.json0.0missing{\n "num_gpu": 99\n}missing
9912Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231225_132021__66300.018.65270[73, 340]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231225_132021__663.json0.0missing{\n "num_gpu": 99\n}missing
9913Apple-MacBook-Pro-M1pig_latinifyorca2:13bInJulia1SHOTfalsefalse520231227_015854__34300.03.750150[73, 57]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__InJulia__1SHOT__20231227_015854__343.json0.0missing{\n "num_gpu": 99\n}missing
9914Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_082042__15500.015.770[99, 454]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_082042__155.json50.0missingmissingmissing
9915Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_131940__53200.016.31540[112, 291]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_131940__532.json0.0missing{\n "num_gpu": 99\n}missing
9916Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_131956__50800.016.2030[112, 289]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_131956__508.json0.0missing{\n "num_gpu": 99\n}missing
9917Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_015850__36300.02.848480[112, 35]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_015850__363.json0.0missing{\n "num_gpu": 99\n}missing
9918Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231214_082026__38300.023.08930[187, 622]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082026__383.json0.0missingmissingmissing
9919Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_131856__75300.047.72540[200, 666]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131856__753.json0.0missing{\n "num_gpu": 99\n}missing
9920Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231225_131924__16500.027.29420[200, 472]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131924__165.json25.0missing{\n "num_gpu": 99\n}missing
9921Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaExpertCoTTask1SHOTtruefalse520231227_015847__16000.028.11880[200, 324]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_015847__160.json25.0missing{\n "num_gpu": 99\n}missing
9922Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTtruefalse520231214_082230__14100.039.82190[11, 1011]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082230__141.json25.0missingmissingmissing
9923Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_132156__78700.015.93080[376, 236]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_132156__787.json0.0missing{\n "num_gpu": 99\n}missing
9924Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_132238__75300.042.34460[376, 693]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_132238__753.json0.0missing{\n "num_gpu": 99\n}missing
9925Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231227_015953__59900.05.013720[376, 36]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015953__599.json0.0missing{\n "num_gpu": 99\n}missing
9926Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTtruefalse520231214_082150__75100.041.6910[370, 984]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_082150__751.json25.0missingmissingmissing
9927Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_132054__87900.015.71770[373, 232]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_132054__879.json0.0missing{\n "num_gpu": 99\n}missing
9928Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTtruefalse520231225_132140__35900.045.86380[373, 752]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_132140__359.json25.0missing{\n "num_gpu": 99\n}missing
9929Apple-MacBook-Pro-M1pig_latinifyorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_015948__41800.053.74840[373, 877]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_015948__418.json0.0missing{\n "num_gpu": 99\n}missing
9930Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_140450__57000.09.881140[60, 387]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_140450__570.json0.0missing{\n "num_gpu": 99\n}missing
9931Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_140502__90400.012.35230[60, 480]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_140502__904.json0.0missing{\n "num_gpu": 99\n}missing
9932Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_140421__89700.031.8240[63, 1160]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_140421__897.json0.0missing{\n "num_gpu": 99\n}missing
9933Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_140440__94400.018.9550[63, 722]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_140440__944.json0.0missing{\n "num_gpu": 99\n}missing
9934Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_021622__31200.036.93020[63, 1314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_021622__312.json0.0missing{\n "num_gpu": 99\n}missing
9935Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_140318__38800.011.00230[100, 420]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_140318__388.json0.0missing{\n "num_gpu": 99\n}missing
9936Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_140349__47600.030.96990[100, 1119]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_140349__476.json0.0missing{\n "num_gpu": 99\n}missing
9937Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_021545__72200.010.37440[100, 394]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_021545__722.json0.0missing{\n "num_gpu": 99\n}missing
9938Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_140305__63600.025.92610[187, 812]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140305__636.json0.0missing{\n "num_gpu": 99\n}missing
9939Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231225_140307__98200.01.668780[187, 45]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_140307__982.json50.0missing{\n "num_gpu": 99\n}missing
9940Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231227_021535__17100.04.905980[187, 36]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021535__171.json25.0missing{\n "num_gpu": 99\n}missing
9941Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_140607__57900.020.90120[352, 715]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140607__579.json0.0missing{\n "num_gpu": 99\n}missing
9942Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_140610__88300.03.172580[352, 80]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_140610__883.json0.0missing{\n "num_gpu": 99\n}missing
9943Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_021648__30100.012.72650[352, 430]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021648__301.json0.0missing{\n "num_gpu": 99\n}missing
9944Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_140531__61900.028.90730[349, 978]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_140531__619.json0.0missing{\n "num_gpu": 99\n}missing
9945Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_140546__57600.015.38410[349, 527]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_140546__576.json0.0missing{\n "num_gpu": 99\n}missing
9946Apple-MacBook-Pro-M1pig_latinifyphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_021635__47600.013.02560[349, 441]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_021635__476.json0.0missing{\n "num_gpu": 99\n}missing
9947Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_082336__53300.018.49040[53, 547]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_082336__533.json0.0missingmissingmissing
9948Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_132847__10300.045.4780[78, 355]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_132847__103.json0.0missing{\n "num_gpu": 99\n}missing
9949Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_132932__75700.045.45160[78, 355]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_132932__757.json0.0missing{\n "num_gpu": 99\n}missing
9950Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruefalse520231214_082317__45800.013.18890[70, 392]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_082317__458.json25.0missingmissingmissing
9951Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruefalse520231225_132708__91700.062.73140[81, 492]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_132708__917.json25.0missing{\n "num_gpu": 99\n}missing
9952Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_132801__48810.052.73084[81, 413]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_132801__488.json80.0missing{\n "num_gpu": 99\n}missing
9953Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2InJulia1SHOTtruefalse520231227_020250__86500.045.02450[81, 345]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_020250__865.json25.0missing{\n "num_gpu": 99\n}missing
9954Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTfalsefalse520231214_082304__37000.014.67840[99, 423]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_082304__370.json0.0missingmissingmissing
9955Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_132510__44120.043.52232[120, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_132510__441.json72.5missing{\n "num_gpu": 99\n}missing
9956Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTtruefalse520231225_132605__30100.054.71920[120, 422]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_132605__301.json25.0missing{\n "num_gpu": 99\n}missing
9957Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_020204__92730.054.74754[120, 417]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_020204__927.json90.0missing{\n "num_gpu": 99\n}missing
9958Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruefalse520231214_082249__19600.019.26820[187, 518]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082249__196.json25.0missingmissingmissing
9959Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_132329__44720.050.74772[208, 197]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_132329__447.json72.5missing{\n "num_gpu": 99\n}missing
9960Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_132426__39120.057.26762[208, 424]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_132426__391.json72.5missing{\n "num_gpu": 99\n}missing
9961Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_020109__49400.076.34430[208, 409]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_020109__494.json50.0missing{\n "num_gpu": 99\n}missing
9962Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTfalsefalse520231214_082410__42100.09.466590[11, 264]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082410__421.json0.0missingmissingmissing
9963Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_133247__65420.053.5722[384, 361]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_133247__654.json72.5missing{\n "num_gpu": 99\n}missing
9964Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231225_133344__45200.057.56740[384, 392]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_133344__452.json25.0missing{\n "num_gpu": 99\n}missing
9965Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_020448__43620.057.87052[384, 391]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_020448__436.json72.5missing{\n "num_gpu": 99\n}missing
9966Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_082400__61800.024.66354[370, 581]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_082400__618.json75.0missingmissingmissing
9967Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231225_133034__78000.061.70810[381, 424]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_133034__780.json25.0missing{\n "num_gpu": 99\n}missing
9968Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_133153__83610.078.8331[381, 555]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_133153__836.json61.25missing{\n "num_gpu": 99\n}missing
9969Apple-MacBook-Pro-M1pig_latinifyphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_020350__47410.059.98141[381, 408]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_020350__474.json61.25missing{\n "num_gpu": 99\n}missing
9970Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_135157__65700.032.57030[70, 554]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_135157__657.json0.0missing{\n "num_gpu": 99\n}missing
9971Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_135221__64800.023.35160[70, 397]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_135221__648.json0.0missing{\n "num_gpu": 99\n}missing
9972Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruefalse520231225_135056__60500.024.47310[73, 416]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_135056__605.json25.0missing{\n "num_gpu": 99\n}missing
9973Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_135124__41710.027.55131[73, 469]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_135124__417.json61.25missing{\n "num_gpu": 99\n}missing
9974Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse520231227_021130__28300.028.06320[73, 476]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_021130__283.json0.0missing{\n "num_gpu": 99\n}missing
9975Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_135002__44200.013.85680[114, 227]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135002__442.json0.0missing{\n "num_gpu": 99\n}missing
9976Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse520231225_135032__60000.029.4790[114, 495]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_135032__600.json25.0missing{\n "num_gpu": 99\n}missing
9977Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_021102__81000.029.52960[114, 494]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_021102__810.json0.0missing{\n "num_gpu": 99\n}missing
9978Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_134926__61600.036.93620[202, 453]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_134926__616.json25.0missing{\n "num_gpu": 99\n}missing
9979Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_134949__99500.022.47640[202, 360]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_134949__995.json0.0missing{\n "num_gpu": 99\n}missing
9980Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_021033__63900.027.36270[202, 293]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_021033__639.json25.0missing{\n "num_gpu": 99\n}missing
9981Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_135331__16200.024.94660[381, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135331__162.json25.0missing{\n "num_gpu": 99\n}missing
9982Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_135413__35000.041.37850[381, 641]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_135413__350.json0.0missing{\n "num_gpu": 99\n}missing
9983Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_021222__28600.022.840[381, 337]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_021222__286.json0.0missing{\n "num_gpu": 99\n}missing
9984Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_135244__15900.023.95560[379, 357]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135244__159.json50.0missing{\n "num_gpu": 99\n}missing
9985Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_135306__56800.021.72730[379, 320]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_135306__568.json50.0missing{\n "num_gpu": 99\n}missing
9986Apple-MacBook-Pro-M1pig_latinifysolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_021159__62600.028.71770[379, 434]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_021159__626.json25.0missing{\n "num_gpu": 99\n}missing
9987Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrAsIs1SHOTfalsefalse520231214_081912__85800.013.80930[53, 415]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_081912__858.json0.0missingmissingmissing
9988Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrAsIs1SHOTfalsefalse520231225_131701__78800.07.286560[72, 415]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_131701__788.json0.0missing{\n "num_gpu": 99\n}missing
9989Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrAsIs1SHOTfalsefalse520231225_131717__92300.016.42770[72, 883]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_131717__923.json0.0missing{\n "num_gpu": 99\n}missing
9990Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTtruefalse520231214_081858__61700.014.83520[70, 441]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_081858__617.json25.0missingmissingmissing
9991Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTfalsefalse520231225_131644__85600.07.917790[75, 450]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_131644__856.json0.0missing{\n "num_gpu": 99\n}missing
9992Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTfalsefalse520231225_131654__76600.09.144370[75, 516]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_131654__766.json0.0missing{\n "num_gpu": 99\n}missing
9993Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrInJulia1SHOTfalsefalse520231227_015800__39800.010.33430[75, 573]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_015800__398.json0.0missing{\n "num_gpu": 99\n}missing
9994Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231214_081843__45800.012.55480[99, 362]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_081843__458.json0.0missingmissingmissing
9995Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_131627__10000.08.097510[112, 451]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_131627__100.json0.0missing{\n "num_gpu": 99\n}missing
9996Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_131637__19800.09.436570[112, 523]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_131637__198.json0.0missing{\n "num_gpu": 99\n}missing
9997Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_015750__70200.010.47330[112, 570]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_015750__702.json0.0missing{\n "num_gpu": 99\n}missing
9998Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_081830__58600.024.72670[187, 663]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081830__586.json50.0missingmissingmissing
9999Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_131612__43100.018.17420[196, 788]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131612__431.json0.0missing{\n "num_gpu": 99\n}missing
10000Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_131619__54200.07.375890[196, 389]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_131619__542.json0.0missing{\n "num_gpu": 99\n}missing
10001Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_015739__32700.012.58230[196, 515]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_015739__327.json0.0missing{\n "num_gpu": 99\n}missing
10002Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231214_082003__71500.025.91450[11, 688]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082003__715.json50.0missingmissingmissing
10003Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_131751__85100.013.94180[362, 666]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131751__851.json0.0missing{\n "num_gpu": 99\n}missing
10004Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_131809__40300.017.88490[362, 847]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_131809__403.json0.0missing{\n "num_gpu": 99\n}missing
10005Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_015819__82500.012.01210[362, 568]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_015819__825.json0.0missing{\n "num_gpu": 99\n}missing
10006Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231214_081937__24000.025.57110[370, 603]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_081937__240.json0.0missingmissingmissing
10007Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_131728__33300.010.34480[360, 492]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_131728__333.json0.0missing{\n "num_gpu": 99\n}missing
10008Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_131737__61600.08.998950[360, 427]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_131737__616.json0.0missing{\n "num_gpu": 99\n}missing
10009Apple-MacBook-Pro-M1pig_latinifystablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_015807__39000.07.262550[360, 334]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_015807__390.json0.0missing{\n "num_gpu": 99\n}missing
10010Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestAsIs1SHOTfalsefalse520231214_080927__88900.023.37170[53, 681]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_080927__889.json0.0missingmissingmissing
10011Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestAsIs1SHOTfalsefalse520231225_123153__63700.011.21830[70, 362]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_123153__637.json0.0missing{\n "num_gpu": 99\n}missing
10012Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestAsIs1SHOTfalsefalse520231225_123202__91300.08.65860[70, 278]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_123202__913.json0.0missing{\n "num_gpu": 99\n}missing
10013Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruefalse520231214_080904__50400.012.11930[70, 361]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_080904__504.json25.0missingmissingmissing
10014Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruefalse520231225_123132__73700.015.63970[73, 507]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_123132__737.json25.0missing{\n "num_gpu": 99\n}missing
10015Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruefalse520231225_123142__92400.09.737970[73, 314]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_123142__924.json25.0missing{\n "num_gpu": 99\n}missing
10016Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestInJulia1SHOTtruetrue520231227_014042__40100.012.15240[73, 391]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_014042__401.json50.0missing{\n "num_gpu": 99\n}missing
10017Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231214_080852__74800.010.8070[99, 312]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_080852__748.json0.0missingmissingmissing
10018Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTfalsefalse520231225_123104__81700.014.2840[114, 455]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_123104__817.json0.0missing{\n "num_gpu": 99\n}missing
10019Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_123116__38300.012.47570[114, 397]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_123116__383.json50.0missing{\n "num_gpu": 99\n}missing
10020Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertAsk1SHOTtruefalse520231227_014029__24600.017.3990[114, 551]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_014029__246.json25.0missing{\n "num_gpu": 99\n}missing
10021Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_080841__52200.021.34630[187, 576]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_080841__522.json0.0missingmissingmissing
10022Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_123037__15600.016.36470[202, 333]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123037__156.json50.0missing{\n "num_gpu": 99\n}missing
10023Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231225_123049__82900.011.84290[202, 357]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123049__829.json0.0missing{\n "num_gpu": 99\n}missing
10024Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_014012__89710.018.81811[202, 415]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_014012__897.json61.25missing{\n "num_gpu": 99\n}missing
10025Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_081006__47400.015.46940[11, 425]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081006__474.json0.0missingmissingmissing
10026Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_123241__94810.011.16971[381, 306]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123241__948.json61.25missing{\n "num_gpu": 99\n}missing
10027Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231225_123253__23700.012.29550[381, 342]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_123253__237.json0.0missing{\n "num_gpu": 99\n}missing
10028Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_014116__93600.022.0621[381, 637]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_014116__936.json56.25missing{\n "num_gpu": 99\n}missing
10029Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_080950__59000.022.88690[370, 536]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_080950__590.json50.0missingmissingmissing
10030Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_123215__46100.012.8571[379, 359]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_123215__461.json56.25missing{\n "num_gpu": 99\n}missing
10031Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_123229__16410.014.18041[379, 401]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_123229__164.json61.25missing{\n "num_gpu": 99\n}missing
10032Apple-MacBook-Pro-M1pig_latinifystarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_014054__28800.012.6410[379, 350]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_014054__288.json50.0missing{\n "num_gpu": 99\n}missing
10033Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatAsIs1SHOTfalsefalse520231214_081115__17000.020.30330[53, 597]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_081115__170.json0.0missingmissingmissing
10034Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatAsIs1SHOTfalsefalse520231225_124251__23300.0107.7180[66, 809]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_124251__233.json0.0missing{\n "num_gpu": 99\n}missing
10035Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatAsIs1SHOTfalsefalse520231225_124417__14000.085.70660[66, 646]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_124417__140.json0.0missing{\n "num_gpu": 99\n}missing
10036Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruefalse520231214_081055__76300.017.83150[70, 524]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_081055__763.json25.0missingmissingmissing
10037Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruefalse520231225_123848__32000.0109.4080[69, 822]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_123848__320.json25.0missing{\n "num_gpu": 99\n}missing
10038Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruetrue520231225_124103__60510.0134.5811[69, 1002]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_124103__605.json61.25missing{\n "num_gpu": 99\n}missing
10039Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatInJulia1SHOTtruefalse520231227_014510__40800.070.84130[69, 533]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_014510__408.json25.0missing{\n "num_gpu": 99\n}missing
10040Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruefalse520231214_081037__41500.013.62360[99, 394]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_081037__415.json25.0missingmissingmissing
10041Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_123608__45500.033.21810[108, 242]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_123608__455.json50.0missing{\n "num_gpu": 99\n}missing
10042Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_123659__81300.050.14180[108, 372]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_123659__813.json50.0missing{\n "num_gpu": 99\n}missing
10043Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_014359__33710.062.84981[108, 467]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_014359__337.json61.25missing{\n "num_gpu": 99\n}missing
10044Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse520231214_081023__30600.017.13990[187, 463]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_081023__306.json25.0missingmissingmissing
10045Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231225_123442__69400.0109.1790[197, 621]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123442__694.json0.0missing{\n "num_gpu": 99\n}missing
10046Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_123535__40810.052.61721[197, 373]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_123535__408.json61.25missing{\n "num_gpu": 99\n}missing
10047Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231227_014255__45500.097.7883[197, 539]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_014255__455.json68.75missing{\n "num_gpu": 99\n}missing
10048Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231214_081158__37100.016.01210[11, 440]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_081158__371.json0.0missingmissingmissing
10049Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231225_124650__77000.010.03210[382, 17]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_124650__770.json0.0missing{\n "num_gpu": 99\n}missing
10050Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_124813__51900.082.49021[382, 558]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_124813__519.json56.25missing{\n "num_gpu": 99\n}missing
10051Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231227_014714__68610.084.03581[382, 567]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_014714__686.json61.25missing{\n "num_gpu": 99\n}missing
10052Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTtruefalse520231214_081142__96100.026.26990[370, 621]0.10.0-DEV41.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_081142__961.json25.0missingmissingmissing
10053Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTfalsefalse520231225_124553__42800.096.17830[380, 657]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_124553__428.json0.0missing{\n "num_gpu": 99\n}missing
10054Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_124640__28910.047.09371[380, 299]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_124640__289.json61.25missing{\n "num_gpu": 99\n}missing
10055Apple-MacBook-Pro-M1pig_latinifyyi:34b-chatJuliaRecapTask1SHOTtruefalse520231227_014550__61800.040.29050[380, 247]0.10.0-DEV41.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/pig_latinify/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_014550__618.json25.0missing{\n "num_gpu": 99\n}missing
10056Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructAsIs1SHOTfalsefalse520231214_083300__26000.015.35490[82, 449]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_083300__260.json0.0missingmissingmissing
10057Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructAsIs1SHOTfalsefalse520231225_095935__40700.016.59570[104, 297]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_095935__407.json0.0missing{\n "num_gpu": 99\n}missing
10058Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructAsIs1SHOTfalsefalse520231225_095950__70000.015.50020[104, 277]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_095950__700.json0.0missing{\n "num_gpu": 99\n}missing
10059Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231214_083245__59000.010.16771[99, 294]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_083245__590.json58.3333missingmissingmissing
10060Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231225_095852__55900.018.93752[107, 341]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_095852__559.json66.6667missing{\n "num_gpu": 99\n}missing
10061Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231225_095918__25300.026.01040[107, 470]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_095918__253.json50.0missing{\n "num_gpu": 99\n}missing
10062Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruetrue520231227_023107__73000.018.30672[107, 327]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_023107__730.json66.6667missing{\n "num_gpu": 99\n}missing
10063Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructInJulia1SHOTtruefalse520231227_081626__77500.08.662740[107, 147]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_081626__775.json25.0missing{\n "num_gpu": 99\n}missing
10064Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_083235__26700.02.743520[128, 60]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_083235__267.json50.0missingmissingmissing
10065Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_095825__93400.016.80321[145, 294]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_095825__934.json58.3333missing{\n "num_gpu": 99\n}missing
10066Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231225_095833__64300.07.495582[145, 119]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_095833__643.json66.6667missing{\n "num_gpu": 99\n}missing
10067Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_023048__36000.022.59642[145, 400]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_023048__360.json66.6667missing{\n "num_gpu": 99\n}missing
10068Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_081617__67500.012.85092[145, 220]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_081617__675.json66.6667missing{\n "num_gpu": 99\n}missing
10069Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231214_083232__94500.019.08770[229, 496]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083232__945.json50.0missingmissingmissing
10070Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_095751__74100.029.93713[247, 334]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_095751__741.json75.0missing{\n "num_gpu": 99\n}missing
10071Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_095808__67400.015.95870[247, 256]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_095808__674.json50.0missing{\n "num_gpu": 99\n}missing
10072Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_023026__47800.030.19532[247, 349]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_023026__478.json66.6667missing{\n "num_gpu": 99\n}missing
10073Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_081604__19400.023.17590[247, 220]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081604__194.json50.0missing{\n "num_gpu": 99\n}missing
10074Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_083351__57600.030.8240[11, 799]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083351__576.json50.0missingmissingmissing
10075Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_100053__33900.028.11591[410, 440]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100053__339.json58.3333missing{\n "num_gpu": 99\n}missing
10076Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_100126__55600.032.62410[410, 514]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100126__556.json50.0missing{\n "num_gpu": 99\n}missing
10077Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_023206__78600.021.97961[410, 337]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_023206__786.json58.3333missing{\n "num_gpu": 99\n}missing
10078Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_081713__67500.021.9731[410, 337]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_081713__675.json58.3333missing{\n "num_gpu": 99\n}missing
10079Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231214_083320__38500.019.2280[399, 428]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_083320__385.json0.0missingmissingmissing
10080Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTfalsefalse520231225_100008__83700.017.44320[407, 257]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_100008__837.json0.0missing{\n "num_gpu": 99\n}missing
10081Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_100024__59200.016.78711[407, 240]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_100024__592.json58.3333missing{\n "num_gpu": 99\n}missing
10082Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_023144__50400.037.00132[407, 595]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_023144__504.json66.6667missing{\n "num_gpu": 99\n}missing
10083Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_081651__91400.025.20540[407, 393]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_081651__914.json50.0missing{\n "num_gpu": 99\n}missing
10084NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043125__29800.02.393112[0, 182]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043125__298.json66.6667missing{\n "num_gpu": 99\n}missing
10085NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043129__32700.04.460130[0, 335]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043129__327.json50.0missing{\n "num_gpu": 99\n}missing
10086NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043132__82700.02.553671[0, 192]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043132__827.json58.3333missing{\n "num_gpu": 99\n}missing
10087NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043135__48800.02.819690[0, 208]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043135__488.json50.0missing{\n "num_gpu": 99\n}missing
10088NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043138__66600.03.454783[0, 262]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043138__666.json75.0missing{\n "num_gpu": 99\n}missing
10089NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043053__42200.03.315913[0, 251]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043053__422.json75.0missing{\n "num_gpu": 99\n}missing
10090NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043055__36600.01.724660[0, 131]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043055__366.json50.0missing{\n "num_gpu": 99\n}missing
10091NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043057__85900.02.575082[0, 195]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043057__859.json66.6667missing{\n "num_gpu": 99\n}missing
10092NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043059__35600.01.833823[0, 139]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043059__356.json75.0missing{\n "num_gpu": 99\n}missing
10093NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043101__71000.01.451632[0, 110]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043101__710.json66.6667missing{\n "num_gpu": 99\n}missing
10094NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_043025__90500.02.805030[0, 211]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043025__905.json50.0missing{\n "num_gpu": 99\n}missing
10095NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043029__10600.04.075410[0, 305]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043029__106.json0.0missing{\n "num_gpu": 99\n}missing
10096NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043031__19800.02.217360[0, 167]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043031__198.json0.0missing{\n "num_gpu": 99\n}missing
10097NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_043034__81000.02.968172[0, 223]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043034__810.json66.6667missing{\n "num_gpu": 99\n}missing
10098NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_043036__28100.02.242852[0, 169]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043036__281.json66.6667missing{\n "num_gpu": 99\n}missing
10099NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043259__21600.06.233292[0, 442]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043259__216.json66.6667missing{\n "num_gpu": 99\n}missing
10100NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_043303__97300.03.993940[0, 285]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043303__973.json0.0missing{\n "num_gpu": 99\n}missing
10101NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043307__20900.04.152690[0, 296]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043307__209.json50.0missing{\n "num_gpu": 99\n}missing
10102NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043312__35600.04.574381[0, 327]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043312__356.json58.3333missing{\n "num_gpu": 99\n}missing
10103NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043319__28400.06.802423[0, 485]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043319__284.json75.0missing{\n "num_gpu": 99\n}missing
10104NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_043208__79600.03.235710[0, 231]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043208__796.json0.0missing{\n "num_gpu": 99\n}missing
10105NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043211__20100.03.605851[0, 257]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043211__201.json58.3333missing{\n "num_gpu": 99\n}missing
10106NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043219__61300.06.950242[0, 490]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043219__613.json66.6667missing{\n "num_gpu": 99\n}missing
10107NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043224__50600.05.063931[0, 369]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043224__506.json58.3333missing{\n "num_gpu": 99\n}missing
10108NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_043227__34100.03.265050[0, 238]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043227__341.json0.0missing{\n "num_gpu": 99\n}missing
10109Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonAsIs1SHOTfalsefalse520231214_083447__79800.017.13340[82, 500]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_083447__798.json0.0missingmissingmissing
10110Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonAsIs1SHOTfalsefalse520231225_100258__39000.027.75590[78, 499]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_100258__390.json0.0missing{\n "num_gpu": 99\n}missing
10111Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonAsIs1SHOTfalsefalse520231225_100308__60400.09.475090[78, 164]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_100308__604.json0.0missing{\n "num_gpu": 99\n}missing
10112Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonInJulia1SHOTfalsefalse520231214_083430__76600.014.29940[99, 414]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_083430__766.json0.0missingmissingmissing
10113Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonInJulia1SHOTtruefalse520231225_100223__56800.07.440020[81, 125]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_100223__568.json25.0missing{\n "num_gpu": 99\n}missing
10114Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonInJulia1SHOTfalsefalse520231225_100230__43400.07.480110[81, 127]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_100230__434.json0.0missing{\n "num_gpu": 99\n}missing
10115Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231214_083415__76800.010.6190[128, 301]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_083415__768.json50.0missingmissingmissing
10116Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_100204__44200.021.15190[82, 381]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_100204__442.json0.0missing{\n "num_gpu": 99\n}missing
10117Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_100215__92300.011.03150[82, 192]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_100215__923.json0.0missing{\n "num_gpu": 99\n}missing
10118Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_083405__32000.014.14341[229, 362]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083405__320.json58.3333missingmissingmissing
10119Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_100141__73500.015.38050[122, 84]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100141__735.json0.0missing{\n "num_gpu": 99\n}missing
10120Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_100143__98300.02.09630[122, 20]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100143__983.json0.0missing{\n "num_gpu": 99\n}missing
10121Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapCoTTask1SHOTtruefalse520231214_083533__72500.017.20720[11, 466]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083533__725.json25.0missingmissingmissing
10122Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_100347__87400.015.57410[99, 273]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100347__874.json0.0missing{\n "num_gpu": 99\n}missing
10123Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_100351__26100.04.275120[99, 62]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100351__261.json0.0missing{\n "num_gpu": 99\n}missing
10124Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231214_083515__39400.028.28690[399, 655]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_083515__394.json0.0missingmissingmissing
10125Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_100315__73600.07.344250[96, 123]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_100315__736.json0.0missing{\n "num_gpu": 99\n}missing
10126Apple-MacBook-Pro-M1q_and_a_extractorcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse520231225_100331__55400.016.2360[96, 288]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_100331__554.json0.0missing{\n "num_gpu": 99\n}missing
10127NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_043824__70300.010.1780[0, 366]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043824__703.json0.0missing{\n "num_gpu": 99\n}missing
10128NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_043833__14300.08.866840[0, 319]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043833__143.json0.0missing{\n "num_gpu": 99\n}missing
10129NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_043846__26900.013.74880[0, 493]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043846__269.json0.0missing{\n "num_gpu": 99\n}missing
10130NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043855__45100.08.255332[0, 297]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043855__451.json66.6667missing{\n "num_gpu": 99\n}missing
10131NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043910__37700.014.97423[0, 536]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043910__377.json75.0missing{\n "num_gpu": 99\n}missing
10132NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043649__41700.03.246260[0, 117]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043649__417.json50.0missing{\n "num_gpu": 99\n}missing
10133NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043659__39600.09.629270[0, 346]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043659__396.json50.0missing{\n "num_gpu": 99\n}missing
10134NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043706__55300.07.350543[0, 264]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043706__553.json75.0missing{\n "num_gpu": 99\n}missing
10135NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_043713__41100.06.753680[0, 243]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043713__411.json0.0missing{\n "num_gpu": 99\n}missing
10136NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_043724__34700.010.52613[0, 378]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043724__347.json75.0missing{\n "num_gpu": 99\n}missing
10137NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043557__74100.00.5149730[0, 18]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043557__741.json0.0missing{\n "num_gpu": 99\n}missing
10138NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043602__24100.05.232860[0, 184]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043602__241.json0.0missing{\n "num_gpu": 99\n}missing
10139NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043606__40800.04.254440[0, 150]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043606__408.json0.0missing{\n "num_gpu": 99\n}missing
10140NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043608__45700.01.592360[0, 56]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043608__457.json0.0missing{\n "num_gpu": 99\n}missing
10141NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043609__73500.01.19070[0, 42]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043609__735.json0.0missing{\n "num_gpu": 99\n}missing
10142NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_044133__55600.04.328760[0, 154]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_044133__556.json0.0missing{\n "num_gpu": 99\n}missing
10143NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_044135__79600.02.12910[0, 76]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_044135__796.json0.0missing{\n "num_gpu": 99\n}missing
10144NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_044145__74800.09.77721[0, 347]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_044145__748.json58.3333missing{\n "num_gpu": 99\n}missing
10145NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_044203__84500.017.75120[0, 626]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_044203__845.json50.0missing{\n "num_gpu": 99\n}missing
10146NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_044206__33800.02.753190[0, 98]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_044206__338.json0.0missing{\n "num_gpu": 99\n}missing
10147NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_043942__91800.07.576470[0, 269]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043942__918.json0.0missing{\n "num_gpu": 99\n}missing
10148NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_043952__33300.010.80020[0, 383]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043952__333.json0.0missing{\n "num_gpu": 99\n}missing
10149NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_044003__77600.010.29390[0, 365]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_044003__776.json0.0missing{\n "num_gpu": 99\n}missing
10150NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_044014__23400.011.71512[0, 415]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_044014__234.json66.6667missing{\n "num_gpu": 99\n}missing
10151NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_044028__28300.012.9390[0, 458]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_044028__283.json50.0missing{\n "num_gpu": 99\n}missing
10152NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_042315__86300.010.60710[0, 261]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_042315__863.json0.0missing{\n "num_gpu": 99\n}missing
10153NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_042322__64300.06.933740[0, 171]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_042322__643.json0.0missing{\n "num_gpu": 99\n}missing
10154NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_042340__84200.017.90630[0, 439]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_042340__842.json0.0missing{\n "num_gpu": 99\n}missing
10155NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_042353__42100.012.53960[0, 308]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_042353__421.json50.0missing{\n "num_gpu": 99\n}missing
10156NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_042401__19100.08.46130[0, 208]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_042401__191.json0.0missing{\n "num_gpu": 99\n}missing
10157NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_042133__82300.014.7532[0, 362]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_042133__823.json66.6667missing{\n "num_gpu": 99\n}missing
10158NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_042137__61600.03.78470[0, 93]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_042137__616.json0.0missing{\n "num_gpu": 99\n}missing
10159NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_042139__96800.01.584740[0, 39]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_042139__968.json0.0missing{\n "num_gpu": 99\n}missing
10160NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_042158__82900.019.6360[0, 480]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_042158__829.json50.0missing{\n "num_gpu": 99\n}missing
10161NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_042214__57200.015.35440[0, 373]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_042214__572.json0.0missing{\n "num_gpu": 99\n}missing
10162NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_041948__64600.018.51621[0, 449]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_041948__646.json58.3333missing{\n "num_gpu": 99\n}missing
10163NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_041955__70100.07.101980[0, 173]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_041955__701.json0.0missing{\n "num_gpu": 99\n}missing
10164NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_042006__54700.010.72761[0, 262]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_042006__547.json58.3333missing{\n "num_gpu": 99\n}missing
10165NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_042014__48500.08.464530[0, 207]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_042014__485.json0.0missing{\n "num_gpu": 99\n}missing
10166NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_042021__54400.07.005420[0, 171]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_042021__544.json0.0missing{\n "num_gpu": 99\n}missing
10167NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_042822__87800.021.52053[0, 518]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_042822__878.json75.0missing{\n "num_gpu": 99\n}missing
10168NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_042850__14900.028.51680[0, 685]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_042850__149.json50.0missing{\n "num_gpu": 99\n}missing
10169NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_042905__78500.014.56930[0, 351]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_042905__785.json0.0missing{\n "num_gpu": 99\n}missing
10170NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_042937__88000.032.06550[0, 770]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_042937__880.json0.0missing{\n "num_gpu": 99\n}missing
10171NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_042958__63700.020.92120[0, 503]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_042958__637.json50.0missing{\n "num_gpu": 99\n}missing
10172NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_042547__72000.016.30120[0, 393]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_042547__720.json50.0missing{\n "num_gpu": 99\n}missing
10173NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_042550__26800.02.922940[0, 71]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_042550__268.json0.0missing{\n "num_gpu": 99\n}missing
10174NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_042608__44000.018.58810[0, 449]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_042608__440.json50.0missing{\n "num_gpu": 99\n}missing
10175NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_042629__72900.020.40010[0, 492]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_042629__729.json50.0missing{\n "num_gpu": 99\n}missing
10176NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_042646__23400.016.63060[0, 402]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_042646__234.json0.0missing{\n "num_gpu": 99\n}missing
10177NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_040201__30600.017.32490[0, 324]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_040201__306.json50.0missing{\n "num_gpu": 99\n}missing
10178NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_040207__33500.05.788820[0, 108]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_040207__335.json0.0missing{\n "num_gpu": 99\n}missing
10179NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_040249__80100.042.12073[0, 781]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_040249__801.json75.0missing{\n "num_gpu": 99\n}missing
10180NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_040316__13700.026.56880[0, 495]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_040316__137.json50.0missing{\n "num_gpu": 99\n}missing
10181NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_040343__32000.027.00981[0, 503]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_040343__320.json58.3333missing{\n "num_gpu": 99\n}missing
10182NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_035957__91900.013.75380[0, 257]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_035957__919.json0.0missing{\n "num_gpu": 99\n}missing
10183NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_040006__47200.08.777580[0, 164]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_040006__472.json0.0missing{\n "num_gpu": 99\n}missing
10184NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_040028__29800.022.37910[0, 417]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_040028__298.json0.0missing{\n "num_gpu": 99\n}missing
10185NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_040042__92400.014.31671[0, 267]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_040042__924.json58.3333missing{\n "num_gpu": 99\n}missing
10186NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_040044__22100.01.77050[0, 33]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_040044__221.json0.0missing{\n "num_gpu": 99\n}missing
10187NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_035708__19000.015.63542[0, 291]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_035708__190.json66.6667missing{\n "num_gpu": 99\n}missing
10188NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_035725__65900.017.25550[0, 320]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_035725__659.json0.0missing{\n "num_gpu": 99\n}missing
10189NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_035755__32500.029.76853[0, 550]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_035755__325.json75.0missing{\n "num_gpu": 99\n}missing
10190NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_035809__29900.014.32740[0, 266]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_035809__299.json0.0missing{\n "num_gpu": 99\n}missing
10191NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_035833__45900.023.42630[0, 433]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_035833__459.json0.0missing{\n "num_gpu": 99\n}missing
10192NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_041707__24300.037.49661[0, 690]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_041707__243.json58.3333missing{\n "num_gpu": 99\n}missing
10193NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_041716__70900.07.993890[0, 148]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_041716__709.json0.0missing{\n "num_gpu": 99\n}missing
10194NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_041732__77300.016.41280[0, 303]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_041732__773.json0.0missing{\n "num_gpu": 99\n}missing
10195NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_041742__50500.010.11290[0, 187]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_041742__505.json0.0missing{\n "num_gpu": 99\n}missing
10196NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_041754__40300.011.78962[0, 218]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_041754__403.json66.6667missing{\n "num_gpu": 99\n}missing
10197NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_041330__60300.070.88910[413, 540]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_041330__603.json50.0missing{\n "num_gpu": 99\n}missing
10198NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_041345__46000.014.92562[0, 275]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_041345__460.json66.6667missing{\n "num_gpu": 99\n}missing
10199NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_041358__14300.012.38190[0, 228]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_041358__143.json0.0missing{\n "num_gpu": 99\n}missing
10200NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_041410__62500.012.76650[0, 235]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_041410__625.json0.0missing{\n "num_gpu": 99\n}missing
10201NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_041429__13800.018.30360[0, 336]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_041429__138.json0.0missing{\n "num_gpu": 99\n}missing
10202NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043411__15100.03.234882[0, 387]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043411__151.json66.6667missing{\n "num_gpu": 99\n}missing
10203NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_043414__89100.02.855020[0, 343]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043414__891.json0.0missing{\n "num_gpu": 99\n}missing
10204NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043418__87400.03.331593[0, 400]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043418__874.json75.0missing{\n "num_gpu": 99\n}missing
10205NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043420__76000.02.267053[0, 273]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043420__760.json75.0missing{\n "num_gpu": 99\n}missing
10206NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_043422__81000.02.279632[0, 274]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_043422__810.json66.6667missing{\n "num_gpu": 99\n}missing
10207NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_043351__17500.01.168140[0, 141]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043351__175.json0.0missing{\n "num_gpu": 99\n}missing
10208NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_043351__58100.00.9201830[0, 110]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043351__581.json0.0missing{\n "num_gpu": 99\n}missing
10209NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_043352__31700.00.9107850[0, 110]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043352__317.json0.0missing{\n "num_gpu": 99\n}missing
10210NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_043353__33100.00.7380130[0, 89]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043353__331.json0.0missing{\n "num_gpu": 99\n}missing
10211NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_043355__21700.01.482410[0, 179]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_043355__217.json0.0missing{\n "num_gpu": 99\n}missing
10212NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043334__74800.01.741670[0, 202]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043334__748.json0.0missing{\n "num_gpu": 99\n}missing
10213NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043335__83300.01.570770[0, 182]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043335__833.json0.0missing{\n "num_gpu": 99\n}missing
10214NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043337__25100.01.701020[0, 197]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043337__251.json0.0missing{\n "num_gpu": 99\n}missing
10215NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043338__75200.01.68980[0, 196]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043338__752.json0.0missing{\n "num_gpu": 99\n}missing
10216NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_043341__51500.02.162120[0, 250]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_043341__515.json0.0missing{\n "num_gpu": 99\n}missing
10217NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043509__94300.04.488020[0, 520]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043509__943.json50.0missing{\n "num_gpu": 99\n}missing
10218NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043512__86800.02.973721[0, 347]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043512__868.json58.3333missing{\n "num_gpu": 99\n}missing
10219NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_043514__99300.01.905660[0, 224]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043514__993.json0.0missing{\n "num_gpu": 99\n}missing
10220NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043517__32200.02.550141[0, 299]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043517__322.json58.3333missing{\n "num_gpu": 99\n}missing
10221NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_043521__28200.03.950311[0, 460]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_043521__282.json58.3333missing{\n "num_gpu": 99\n}missing
10222NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043439__73800.03.35343[0, 392]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043439__738.json75.0missing{\n "num_gpu": 99\n}missing
10223NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043441__23900.01.781223[0, 209]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043441__239.json75.0missing{\n "num_gpu": 99\n}missing
10224NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043443__91700.02.568453[0, 300]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043443__917.json75.0missing{\n "num_gpu": 99\n}missing
10225NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043446__34000.02.154070[0, 253]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043446__340.json50.0missing{\n "num_gpu": 99\n}missing
10226NVIDIA-RTX-4090-4xq_and_a_extractorcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_043449__78000.02.47773[0, 291]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_043449__780.json75.0missing{\n "num_gpu": 99\n}missing
10227Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_111945__48300.061.55050[104, 360]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_111945__483.json0.0missing{\n "num_gpu": 99\n}missing
10228Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_112039__48400.054.59680[104, 311]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_112039__484.json0.0missing{\n "num_gpu": 99\n}missing
10229Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_111843__90600.048.71370[107, 283]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_111843__906.json0.0missing{\n "num_gpu": 99\n}missing
10230Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_082923__51300.063.5642[107, 380]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_082923__513.json66.6667missing{\n "num_gpu": 99\n}missing
10231Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_102435__20000.050.67830[148, 295]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_102435__200.json0.0missing{\n "num_gpu": 99\n}missing
10232Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_102514__11900.039.70930[148, 227]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_102514__119.json0.0missing{\n "num_gpu": 99\n}missing
10233Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_082819__57300.044.69340[148, 257]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_082819__573.json0.0missing{\n "num_gpu": 99\n}missing
10234Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_102257__56700.077.13850[250, 277]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_102257__567.json0.0missing{\n "num_gpu": 99\n}missing
10235Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_102344__80000.047.11440[250, 256]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_102344__800.json0.0missing{\n "num_gpu": 99\n}missing
10236Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_082734__75000.091.89280[250, 377]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_082734__750.json0.0missing{\n "num_gpu": 99\n}missing
10237Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_112409__14300.072.65610[436, 375]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_112409__143.json0.0missing{\n "num_gpu": 99\n}missing
10238Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_112536__49500.086.51730[436, 458]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_112536__495.json0.0missing{\n "num_gpu": 99\n}missing
10239Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_083159__49200.076.51463[436, 398]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083159__492.json75.0missing{\n "num_gpu": 99\n}missing
10240Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_112130__29200.050.56653[434, 235]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112130__292.json75.0missing{\n "num_gpu": 99\n}missing
10241Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_112256__88900.085.51610[434, 442]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112256__889.json0.0missing{\n "num_gpu": 99\n}missing
10242Apple-MacBook-Pro-M1q_and_a_extractordeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_083042__18200.078.91850[434, 412]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083042__182.json0.0missing{\n "num_gpu": 99\n}missing
10243Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_084044__25800.010.17250[102, 386]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_084044__258.json0.0missing{\n "num_gpu": 99\n}missing
10244Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruefalse520231227_125708__39400.09.269250[102, 345]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_125708__394.json25.0missing{\n "num_gpu": 99\n}missing
10245Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_125728__27800.020.35210[102, 745]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_125728__278.json0.0missing{\n "num_gpu": 99\n}missing
10246Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_125739__65400.010.65760[102, 404]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_125739__654.json0.0missing{\n "num_gpu": 99\n}missing
10247Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_084033__41000.05.950060[139, 219]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_084033__410.json50.0missing{\n "num_gpu": 99\n}missing
10248Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_125635__41900.03.496610[139, 119]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_125635__419.json0.0missing{\n "num_gpu": 99\n}missing
10249Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_125641__18900.06.558090[139, 232]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_125641__189.json0.0missing{\n "num_gpu": 99\n}missing
10250Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_125659__58100.017.27920[139, 616]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_125659__581.json0.0missing{\n "num_gpu": 99\n}missing
10251Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_084028__55500.011.48240[238, 282]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084028__555.json0.0missing{\n "num_gpu": 99\n}missing
10252Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_125623__89900.08.23740[238, 150]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_125623__899.json0.0missing{\n "num_gpu": 99\n}missing
10253Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_125627__17200.04.308910[238, 136]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_125627__172.json0.0missing{\n "num_gpu": 99\n}missing
10254Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_125631__18700.04.141380[238, 129]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_125631__187.json0.0missing{\n "num_gpu": 99\n}missing
10255Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_084057__71900.06.968470[391, 212]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084057__719.json0.0missing{\n "num_gpu": 99\n}missing
10256Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_125815__59200.09.324380[391, 297]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125815__592.json0.0missing{\n "num_gpu": 99\n}missing
10257Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_125827__86200.011.3810[391, 366]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125827__862.json0.0missing{\n "num_gpu": 99\n}missing
10258Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_125836__67200.09.783390[391, 313]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_125836__672.json0.0missing{\n "num_gpu": 99\n}missing
10259Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_084050__44900.05.990480[388, 176]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_084050__449.json0.0missing{\n "num_gpu": 99\n}missing
10260Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_125748__86000.08.842510[388, 280]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_125748__860.json50.0missing{\n "num_gpu": 99\n}missing
10261Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_125757__64500.09.461610[388, 302]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_125757__645.json50.0missing{\n "num_gpu": 99\n}missing
10262Apple-MacBook-Pro-M1q_and_a_extractordolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_125806__58200.08.469730[388, 266]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_125806__582.json0.0missing{\n "num_gpu": 99\n}missing
10263Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_112030__85600.06.923610[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112030__856.json0.0missingmissingmissing
10264Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112036__77500.06.257940[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112036__775.json50.0missingmissingmissing
10265Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112047__55500.010.81390[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112047__555.json50.0missingmissingmissing
10266Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestInJulia1SHOTfalsefalse520240217_112051__28600.04.547010[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112051__286.json0.0missingmissingmissing
10267Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112055__60800.03.120450[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112055__608.json50.0missingmissingmissing
10268Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_111931__35200.02.170090[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111931__352.json25.0missingmissingmissing
10269Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_111939__46400.07.203480[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111939__464.json25.0missingmissingmissing
10270Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_111942__92100.03.491110[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111942__921.json50.0missingmissingmissing
10271Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse520240217_111953__32600.010.70460[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111953__326.json25.0missingmissingmissing
10272Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse520240217_111956__15900.02.776710[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_111956__159.json0.0missingmissingmissing
10273Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse520240217_111826__71200.03.103330[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111826__712.json0.0missingmissingmissing
10274Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111829__11700.02.49330[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111829__117.json50.0missingmissingmissing
10275Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111839__49400.010.40410[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111839__494.json50.0missingmissingmissing
10276Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111851__75000.011.88360[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111851__750.json50.0missingmissingmissing
10277Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_111853__18100.01.964420[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_111853__181.json50.0missingmissingmissing
10278Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_112200__93700.02.422110[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112200__937.json0.0missingmissingmissing
10279Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_112206__46300.05.156610[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112206__463.json0.0missingmissingmissing
10280Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_112209__16800.03.574190[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112209__168.json0.0missingmissingmissing
10281Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_112213__69300.03.457510[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112213__693.json50.0missingmissingmissing
10282Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_112216__41300.03.182710[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112216__413.json0.0missingmissingmissing
10283Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_112113__64200.04.068943[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112113__642.json75.0missingmissingmissing
10284Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_112121__74500.07.951910[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112121__745.json0.0missingmissingmissing
10285Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_112125__86200.03.241381[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112125__862.json58.3333missingmissingmissing
10286Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_112128__31100.02.799650[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112128__311.json50.0missingmissingmissing
10287Apple-MacBook-Pro-M1q_and_a_extractorgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse520240217_112135__75900.07.258040[0, 0]0.13.0-DEV31.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112135__759.json0.0missingmissingmissing
10288Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240224_001959__52200.024.08240[0, 369]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_001959__522.json0.0missingmissingmissing
10289Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240224_002025__82900.026.30180[0, 402]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_002025__829.json0.0missingmissingmissing
10290Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240224_002048__92000.022.44190[0, 344]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_002048__920.json0.0missingmissingmissing
10291Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240224_002110__77800.022.10420[0, 335]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_002110__778.json0.0missingmissingmissing
10292Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse520240224_002129__12000.019.00480[0, 287]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_002129__120.json0.0missingmissingmissing
10293Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240224_001636__48900.020.4431[0, 316]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_001636__489.json58.3333missingmissingmissing
10294Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240224_001658__67700.021.73480[0, 329]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_001658__677.json0.0missingmissingmissing
10295Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruetrue520240224_001716__93000.018.37840[0, 282]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_001716__930.json50.0missingmissingmissing
10296Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240224_001723__60200.07.018630[0, 111]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_001723__602.json25.0missingmissingmissing
10297Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTtruefalse520240224_001729__17000.06.133380[0, 92]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_001729__170.json25.0missingmissingmissing
10298Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_001306__64200.027.03550[0, 414]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_001306__642.json25.0missingmissingmissing
10299Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse520240224_001336__49600.030.22960[0, 463]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_001336__496.json0.0missingmissingmissing
10300Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_001401__61600.024.71260[0, 379]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_001401__616.json25.0missingmissingmissing
10301Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_001429__42300.028.71640[0, 439]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_001429__423.json25.0missingmissingmissing
10302Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_001454__22900.024.8320[0, 382]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_001454__229.json25.0missingmissingmissing
10303Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_002829__46400.027.46251[0, 418]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_002829__464.json58.3333missingmissingmissing
10304Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240224_002857__75600.027.35910[0, 413]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_002857__756.json0.0missingmissingmissing
10305Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240224_002923__29800.026.36540[0, 400]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_002923__298.json0.0missingmissingmissing
10306Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_002952__89800.028.6470[0, 438]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_002952__898.json50.0missingmissingmissing
10307Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse520240224_003015__35500.023.00780[0, 344]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_003015__355.json0.0missingmissingmissing
10308Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240224_002401__54300.028.11480[0, 425]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_002401__543.json0.0missingmissingmissing
10309Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_002426__49400.024.5420[0, 373]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_002426__494.json50.0missingmissingmissing
10310Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240224_002454__26300.027.55480[0, 414]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_002454__263.json0.0missingmissingmissing
10311Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse520240224_002519__14400.025.71870[0, 390]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_002519__144.json0.0missingmissingmissing
10312Apple-MacBook-Pro-M1q_and_a_extractorgemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_002545__75900.025.6040[0, 383]0.13.0-DEV31.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_002545__759.json50.0missingmissingmissing
10313Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboAsIs1SHOTfalsefalse520231213_204752__85500.00033654.278690[88, 195]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_204752__855.json0.0missingmissingmissing
10314Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboAsIs1SHOTfalsefalse520231225_225709__75000.00073556.42480[88, 461]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_225709__750.json0.0missingmissingmissing
10315Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboAsIs1SHOTfalsefalse520231225_225712__19900.00040253.55470[88, 239]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_225712__199.json0.0missingmissingmissing
10316Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo--optimAsIs1SHOTfalsefalse520231215_201032__35100.05.959390[88, 245]0.10.0-DEV31.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_201032__351.json0.00.5missing0.5
10317Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboInJulia1SHOTtruetrue520231213_204748__27800.0006689.464672[91, 415]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_204748__278.json66.6667missingmissingmissing
10318Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboInJulia1SHOTtruetrue520231225_225658__64600.00054054.513223[91, 330]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_225658__646.json75.0missingmissingmissing
10319Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboInJulia1SHOTtruetrue520231225_225702__63000.0004674.206360[91, 281]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_225702__630.json50.0missingmissingmissing
10320Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboInJulia1SHOTtruetrue520231227_204418__71800.0004194.139041[91, 249]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_204418__718.json58.3333missingmissingmissing
10321Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboInJulia1SHOTtruetrue520231227_204424__78000.000565.974970[91, 343]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_204424__780.json50.0missingmissingmissing
10322Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_201026__11600.05.966813[91, 288]0.10.0-DEV31.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_201026__116.json75.00.5missing0.5
10323Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231213_204738__56600.0003846.757231[126, 214]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_204738__566.json58.3333missingmissingmissing
10324Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_225652__66100.00048753.972992[126, 283]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_225652__661.json66.6667missingmissingmissing
10325Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertAsk1SHOTfalsefalse520231225_225653__80200.00014851.183040[126, 57]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_225653__802.json0.0missingmissingmissing
10326Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertAsk1SHOTfalsefalse520231227_204412__43100.00042154.486280[126, 239]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_204412__431.json0.0missingmissingmissing
10327Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_204414__84700.00022052.051933[126, 105]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_204414__847.json75.0missingmissingmissing
10328Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_201020__12300.02.128911[126, 74]0.10.0-DEV31.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_201020__123.json58.33330.5missing0.5
10329Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231213_204731__42700.00058858.252512[208, 323]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_204731__427.json66.6667missingmissingmissing
10330Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_225645__96500.0003682.786190[208, 176]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225645__965.json50.0missingmissingmissing
10331Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231225_225647__54500.00030051.893720[208, 131]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225647__545.json50.0missingmissingmissing
10332Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_204406__31900.0002331.897060[208, 86]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_204406__319.json0.0missingmissingmissing
10333Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_204407__50500.00023751.588680[208, 89]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_204407__505.json0.0missingmissingmissing
10334Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTfalsefalse520231215_201017__70000.02.768780[208, 112]0.10.0-DEV31.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201017__700.json0.00.5missing0.5
10335Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231213_204802__41700.00062457.40180[349, 300]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_204802__417.json50.0missingmissingmissing
10336Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_225719__77000.00024650.9133310[349, 48]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225719__770.json0.0missingmissingmissing
10337Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_225721__82700.0003652.255950[349, 127]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225721__827.json0.0missingmissingmissing
10338Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_204433__48100.0004253.154760[349, 167]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204433__481.json0.0missingmissingmissing
10339Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_204438__65700.0006474.868883[349, 315]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204438__657.json75.0missingmissingmissing
10340Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_201035__38500.01.556450[349, 64]0.10.0-DEV31.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201035__385.json0.00.5missing0.5
10341Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_204755__52900.00031352.576550[348, 93]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_204755__529.json0.0missingmissingmissing
10342Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_225714__17900.00037652.016580[348, 135]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_225714__179.json0.0missingmissingmissing
10343Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_225718__29200.0006183.886240[348, 296]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_225718__292.json0.0missingmissingmissing
10344Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_204426__58700.0003211.71960[348, 98]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_204426__587.json0.0missingmissingmissing
10345Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_204430__16900.0004593.574610[348, 190]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_204430__169.json0.0missingmissingmissing
10346Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_201034__16900.01.872530[348, 68]0.10.0-DEV31.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_201034__169.json0.00.5missing0.5
10347Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200645__12400.0003171.569330[91, 181]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200645__124.json50.0missingmissingmissing
10348Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200647__39800.0003921.888691[91, 231]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200647__398.json58.3333missingmissingmissing
10349Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200650__57900.00048952.294473[91, 296]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200650__579.json75.0missingmissingmissing
10350Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200651__30800.00029451.318730[91, 166]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200651__308.json50.0missingmissingmissing
10351Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200652__28400.0002271.1870[91, 121]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200652__284.json50.0missingmissingmissing
10352Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200640__52000.0002431.189650[126, 120]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200640__520.json50.0missingmissingmissing
10353Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200641__43000.00017250.7890470[126, 73]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200641__430.json50.0missingmissingmissing
10354Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200642__96400.000150.8178191[126, 58]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200642__964.json58.3333missingmissingmissing
10355Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200643__64700.00017250.9218150[126, 73]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200643__647.json50.0missingmissingmissing
10356Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200644__51000.00016950.7354780[126, 71]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200644__510.json50.0missingmissingmissing
10357Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200635__51600.00029451.241490[208, 127]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200635__516.json25.0missingmissingmissing
10358Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200636__10100.0002661.121060[208, 108]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200636__101.json25.0missingmissingmissing
10359Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruefalse520240201_200637__17900.00032751.159960[208, 149]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200637__179.json25.0missingmissingmissing
10360Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200638__84200.00024351.038561[208, 93]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200638__842.json58.3333missingmissingmissing
10361Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTfalsefalse520240201_200639__37600.00027651.043530[208, 115]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200639__376.json0.0missingmissingmissing
10362Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200700__14500.0003021.042520[349, 85]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200700__145.json0.0missingmissingmissing
10363Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200701__62500.00030350.9232070[349, 86]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200701__625.json0.0missingmissingmissing
10364Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200701__77300.000230.7085390[349, 37]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200701__773.json0.0missingmissingmissing
10365Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200702__82800.00025550.6878810[349, 54]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200702__828.json0.0missingmissingmissing
10366Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200703__77200.00028850.7925520[349, 76]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200703__772.json0.0missingmissingmissing
10367Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200653__36300.00030450.8658590[348, 87]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200653__363.json50.0missingmissingmissing
10368Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200655__10100.00047251.682562[348, 199]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200655__101.json66.6667missingmissingmissing
10369Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200656__19200.0003781.120481[348, 136]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200656__192.json58.3333missingmissingmissing
10370Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse520240201_200657__63800.000330.9517820[348, 104]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200657__638.json0.0missingmissingmissing
10371Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200659__48700.00043951.596681[348, 177]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200659__487.json58.3333missingmissingmissing
10372Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231213_204817__53000.0005964.705240[88, 254]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_204817__530.json0.0missingmissingmissing
10373Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_225734__71200.0002981.65540[88, 105]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_225734__712.json0.0missingmissingmissing
10374Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106AsIs1SHOTfalsefalse520231225_225737__76500.000512.396090[88, 211]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_225737__765.json0.0missingmissingmissing
10375Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse520231215_201048__72100.04.444820[88, 182]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_201048__721.json0.00.9missing0.1
10376Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_204812__68000.0006034.793661[91, 256]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_204812__680.json58.3333missingmissingmissing
10377Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_225730__69700.0005752.66990[91, 242]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_225730__697.json50.0missingmissingmissing
10378Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_225732__79400.0004372.405823[91, 173]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_225732__794.json75.0missingmissingmissing
10379Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106InJulia1SHOTfalsefalse520231227_204447__72600.0004152.572660[91, 162]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_204447__726.json0.0missingmissingmissing
10380Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_204450__28700.0004512.355233[91, 180]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_204450__287.json75.0missingmissingmissing
10381Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_201043__86300.02.984431[91, 163]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_201043__863.json58.33330.9missing0.1
10382Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_204807__60200.0002561.814191[126, 65]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_204807__602.json58.3333missingmissingmissing
10383Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_225726__51700.0002361.049371[126, 55]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_225726__517.json58.3333missingmissingmissing
10384Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_225727__98200.0002721.129210[126, 73]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_225727__982.json50.0missingmissingmissing
10385Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_204443__42400.0003081.814170[126, 91]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_204443__424.json50.0missingmissingmissing
10386Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_204445__98200.0002921.402650[126, 83]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_204445__982.json50.0missingmissingmissing
10387Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_201040__91800.02.49321[126, 66]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_201040__918.json58.33330.9missing0.1
10388Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_204805__43600.000362.279630[208, 76]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_204805__436.json50.0missingmissingmissing
10389Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231225_225723__81700.000431.83170[208, 111]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225723__817.json25.0missingmissingmissing
10390Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231225_225725__13600.000411.37950[208, 101]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225725__136.json25.0missingmissingmissing
10391Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruefalse520231227_204440__99100.0004081.718690[208, 100]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_204440__991.json25.0missingmissingmissing
10392Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_204441__67200.0003981.618191[208, 95]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_204441__672.json58.3333missingmissingmissing
10393Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruefalse520231215_201037__40200.02.027090[208, 106]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201037__402.json25.00.9missing0.1
10394Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231213_204823__93700.0005391.991233[349, 95]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_204823__937.json75.0missingmissingmissing
10395Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_225740__67500.0004350.9564850[349, 43]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225740__675.json0.0missingmissingmissing
10396Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_225741__79800.0005311.205660[349, 91]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_225741__798.json0.0missingmissingmissing
10397Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_204454__18300.0005832.25960[349, 117]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204454__183.json0.0missingmissingmissing
10398Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_204456__61400.0005371.884940[349, 94]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204456__614.json0.0missingmissingmissing
10399Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_201051__81400.01.284060[349, 74]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201051__814.json0.00.9missing0.1
10400Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231213_204821__18700.0005443.8132[348, 98]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_204821__187.json66.6667missingmissingmissing
10401Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231225_225738__22200.000460.9825610[348, 56]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_225738__222.json0.0missingmissingmissing
10402Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_225739__95300.0005521.474542[348, 102]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_225739__953.json66.6667missingmissingmissing
10403Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_204451__82200.000431.014940[348, 41]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_204451__822.json0.0missingmissingmissing
10404Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231227_204452__97700.0004641.023770[348, 58]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_204452__977.json0.0missingmissingmissing
10405Apple-MacBook-Pro-M1q_and_a_extractorgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTfalsefalse520231215_201050__82100.02.433520[348, 99]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_201050__821.json0.00.9missing0.1
10406Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewInJulia1SHOTfalsefalse520240201_111819__88000.0169624.80690[91, 535]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_111819__880.json0.0missingmissingmissing
10407Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewInJulia1SHOTtruetrue520240201_111858__29100.0164838.31552[91, 519]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_111858__291.json66.6667missingmissingmissing
10408Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewInJulia1SHOTfalsefalse520240201_111932__90600.0176234.76240[91, 557]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_111932__906.json0.0missingmissingmissing
10409Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewInJulia1SHOTfalsefalse520240201_112000__20600.0136627.53640[91, 425]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_112000__206.json0.0missingmissingmissing
10410Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewInJulia1SHOTtruetrue520240201_112116__57800.018476.14332[91, 583]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_112116__578.json66.6667missingmissingmissing
10411Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_111416__86300.0054314.24430[126, 139]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_111416__863.json50.0missingmissingmissing
10412Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_111426__25600.0086710.06742[126, 247]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_111426__256.json66.6667missingmissingmissing
10413Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_111438__90500.0045912.35442[126, 111]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_111438__905.json66.6667missingmissingmissing
10414Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_111448__51000.0041710.17970[126, 97]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_111448__510.json50.0missingmissingmissing
10415Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_111459__70000.0056411.03912[126, 146]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_111459__700.json66.6667missingmissingmissing
10416Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse520240201_111050__17900.006679.602270[208, 153]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_111050__179.json0.0missingmissingmissing
10417Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_111134__40200.0151944.13642[208, 437]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_111134__402.json66.6667missingmissingmissing
10418Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse520240201_111153__87500.011218.57340[208, 304]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_111153__875.json0.0missingmissingmissing
10419Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_111238__69800.0167245.13520[208, 488]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_111238__698.json50.0missingmissingmissing
10420Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaExpertCoTTask1SHOTfalsefalse520240201_111310__77200.0110531.7880[208, 299]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_111310__772.json0.0missingmissingmissing
10421Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_113149__59900.0203234.30143[349, 561]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_113149__599.json75.0missingmissingmissing
10422Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_113306__52300.0207776.31420[349, 576]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_113306__523.json50.0missingmissingmissing
10423Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_113348__58400.0186442.37833[349, 505]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_113348__584.json75.0missingmissingmissing
10424Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_113420__36500.0193332.32873[349, 528]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_113420__365.json75.0missingmissingmissing
10425Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapCoTTask1SHOTfalsefalse520240201_113501__99500.0207740.28670[349, 576]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_113501__995.json0.0missingmissingmissing
10426Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_112511__13700.0182144.86013[348, 491]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_112511__137.json75.0missingmissingmissing
10427Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_112600__70000.0252648.87663[348, 726]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_112600__700.json75.0missingmissingmissing
10428Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapTask1SHOTfalsefalse520240201_112635__26900.0159634.65110[348, 416]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_112635__269.json0.0missingmissingmissing
10429Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_112701__46900.0177626.64973[348, 476]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_112701__469.json75.0missingmissingmissing
10430Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_112753__25000.0213351.39122[348, 595]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_112753__250.json66.6667missingmissingmissing
10431Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewAsIs1SHOTfalsefalse520231213_205033__36400.0141746.30390[88, 443]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_205033__364.json0.0missingmissingmissing
10432Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_225918__95100.0165717.74970[88, 523]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_225918__951.json0.0missingmissingmissing
10433Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewAsIs1SHOTfalsefalse520231225_225937__98800.0153719.22430[88, 483]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_225937__988.json0.0missingmissingmissing
10434Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-preview--optimAsIs1SHOTfalsefalse520231215_201231__13400.028.20580[88, 396]0.10.0-DEV31.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_201231__134.json0.00.1missing0.9
10435Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewInJulia1SHOTtruetrue520231213_204946__87300.0192145.88492[91, 610]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_204946__873.json66.6667missingmissingmissing
10436Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewInJulia1SHOTtruetrue520231225_225841__95600.0143215.85112[91, 447]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_225841__956.json66.6667missingmissingmissing
10437Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewInJulia1SHOTtruetrue520231225_225900__81100.0149218.20852[91, 467]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_225900__811.json66.6667missingmissingmissing
10438Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewInJulia1SHOTtruetrue520231227_204649__83300.0143838.66170[91, 449]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_204649__833.json50.0missingmissingmissing
10439Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewInJulia1SHOTfalsefalse520231227_204732__51100.0159142.18580[91, 500]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_204732__511.json0.0missingmissingmissing
10440Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_201203__48200.030.61332[91, 449]0.10.0-DEV31.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_201203__482.json66.66670.1missing0.9
10441Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_204900__80500.0050114.09620[126, 125]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_204900__805.json50.0missingmissingmissing
10442Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_225817__91900.008318.619032[126, 235]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_225817__919.json66.6667missingmissingmissing
10443Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_225825__28400.007238.097452[126, 199]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_225825__284.json66.6667missingmissingmissing
10444Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertAsk1SHOTtruefalse520231227_204600__12800.0076211.77650[126, 212]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_204600__128.json25.0missingmissingmissing
10445Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertAsk1SHOTtruefalse520231227_204611__16200.0064211.05970[126, 172]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_204611__162.json25.0missingmissingmissing
10446Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_201132__92300.015.41092[126, 207]0.10.0-DEV31.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_201132__923.json66.66670.1missing0.9
10447Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_204846__80600.0126423.5152[208, 352]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_204846__806.json66.6667missingmissingmissing
10448Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_225758__26900.0115616.06592[208, 316]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225758__269.json66.6667missingmissingmissing
10449Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertCoTTask1SHOTfalsefalse520231225_225808__51100.011510.70090[208, 314]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_225808__511.json0.0missingmissingmissing
10450Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231227_204523__28700.0074827.02660[208, 180]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_204523__287.json25.0missingmissingmissing
10451Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruefalse520231227_204548__15600.0100324.40770[208, 265]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_204548__156.json25.0missingmissingmissing
10452Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_201116__66400.025.02012[208, 302]0.10.0-DEV31.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201116__664.json66.66670.1missing0.9
10453Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_205146__77100.0194541.65483[349, 532]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_205146__771.json75.0missingmissingmissing
10454Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_230028__85700.0197519.34263[349, 542]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230028__857.json75.0missingmissingmissing
10455Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_230055__85300.0169927.31043[349, 450]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230055__853.json75.0missingmissingmissing
10456Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_204910__24600.010316.58250[349, 227]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204910__246.json50.0missingmissingmissing
10457Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_204958__68900.0224548.38333[349, 632]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_204958__689.json75.0missingmissingmissing
10458Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_201415__46400.057.93283[349, 499]0.10.0-DEV31.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201415__464.json75.00.1missing0.9
10459Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_205104__81800.015330.82313[348, 394]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_205104__818.json75.0missingmissingmissing
10460Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_225955__78700.0181517.67871[348, 489]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_225955__787.json58.3333missingmissingmissing
10461Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_230008__72300.014413.25953[348, 364]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_230008__723.json75.0missingmissingmissing
10462Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_204812__76700.0238240.65521[348, 678]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_204812__767.json58.3333missingmissingmissing
10463Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_204853__33100.0186640.30720[348, 506]0.10.0-DEV31.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_204853__331.json50.0missingmissingmissing
10464Apple-MacBook-Pro-M1q_and_a_extractorgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_201317__72500.045.40663[348, 508]0.10.0-DEV31.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_201317__725.json75.00.1missing0.9
10465Apple-MacBook-Pro-M1q_and_a_extractorllama2AsIs1SHOTfalsefalse520231214_082517__82300.017.03730[82, 496]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__AsIs__1SHOT__20231214_082517__823.json0.0missingmissingmissing
10466Apple-MacBook-Pro-M1q_and_a_extractorllama2AsIs1SHOTfalsefalse520231225_093813__89600.017.19440[82, 504]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__AsIs__1SHOT__20231225_093813__896.json0.0missing{\n "num_gpu": 99\n}missing
10467Apple-MacBook-Pro-M1q_and_a_extractorllama2AsIs1SHOTfalsefalse520231225_093826__89600.012.90060[1, 398]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__AsIs__1SHOT__20231225_093826__896.json0.0missing{\n "num_gpu": 99\n}missing
10468Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231214_082500__22500.014.1940[99, 411]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231214_082500__225.json50.0missingmissingmissing
10469Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231225_093736__27400.028.7210[99, 806]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231225_093736__274.json50.0missing{\n "num_gpu": 99\n}missing
10470Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231225_093755__70200.019.3520[1, 578]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231225_093755__702.json50.0missing{\n "num_gpu": 99\n}missing
10471Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231227_022112__80000.010.02060[99, 295]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231227_022112__800.json50.0missing{\n "num_gpu": 99\n}missing
10472Apple-MacBook-Pro-M1q_and_a_extractorllama2InJulia1SHOTtruetrue520231227_080554__50400.021.28070[99, 614]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__InJulia__1SHOT__20231227_080554__504.json50.0missing{\n "num_gpu": 99\n}missing
10473Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTfalsefalse520231214_082446__58700.015.49850[128, 440]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_082446__587.json0.0missingmissingmissing
10474Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruetrue520231225_093658__70700.06.292490[128, 173]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_093658__707.json50.0missing{\n "num_gpu": 99\n}missing
10475Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruetrue520231225_093707__36700.08.542170[1, 266]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_093707__367.json50.0missing{\n "num_gpu": 99\n}missing
10476Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTfalsefalse520231227_022102__52200.011.28930[128, 326]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_022102__522.json0.0missing{\n "num_gpu": 99\n}missing
10477Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertAsk1SHOTtruetrue520231227_080531__30800.010.11580[128, 287]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_080531__308.json50.0missing{\n "num_gpu": 99\n}missing
10478Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruetrue520231214_082431__59600.020.62580[229, 537]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082431__596.json50.0missingmissingmissing
10479Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruetrue520231225_093640__41300.021.94712[247, 436]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093640__413.json66.6667missing{\n "num_gpu": 99\n}missing
10480Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTtruetrue520231225_093652__23300.012.07590[1, 356]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093652__233.json50.0missing{\n "num_gpu": 99\n}missing
10481Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTfalsefalse520231227_022051__50600.023.16670[247, 485]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022051__506.json0.0missing{\n "num_gpu": 99\n}missing
10482Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaExpertCoTTask1SHOTfalsefalse520231227_080521__22000.023.1070[247, 373]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_080521__220.json0.0missing{\n "num_gpu": 99\n}missing
10483Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTfalsefalse520231214_082600__49300.019.50820[11, 525]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082600__493.json0.0missingmissingmissing
10484Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTfalsefalse520231225_093930__73700.021.69140[11, 582]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093930__737.json0.0missing{\n "num_gpu": 99\n}missing
10485Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTtruetrue520231225_093951__41400.020.47820[1, 557]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093951__414.json50.0missing{\n "num_gpu": 99\n}missing
10486Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTtruetrue520231227_022215__44300.024.55590[11, 659]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022215__443.json50.0missing{\n "num_gpu": 99\n}missing
10487Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapCoTTask1SHOTfalsefalse520231227_080621__39400.04.804780[11, 135]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_080621__394.json0.0missing{\n "num_gpu": 99\n}missing
10488Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruetrue520231214_082541__57500.023.02490[399, 525]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_082541__575.json50.0missingmissingmissing
10489Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruetrue520231225_093846__99200.019.99810[399, 450]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_093846__992.json50.0missing{\n "num_gpu": 99\n}missing
10490Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTtruetrue520231225_093908__41900.022.7660[1, 613]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_093908__419.json50.0missing{\n "num_gpu": 99\n}missing
10491Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTfalsefalse520231227_022150__81600.037.83670[399, 892]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_022150__816.json0.0missing{\n "num_gpu": 99\n}missing
10492Apple-MacBook-Pro-M1q_and_a_extractorllama2JuliaRecapTask1SHOTfalsefalse520231227_080616__57600.021.84560[399, 502]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_080616__576.json0.0missing{\n "num_gpu": 99\n}missing
10493Apple-MacBook-Pro-M1q_and_a_extractormagicoderAsIs1SHOTfalsefalse520231214_083641__43300.017.73230[82, 516]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__AsIs__1SHOT__20231214_083641__433.json0.0missingmissingmissing
10494Apple-MacBook-Pro-M1q_and_a_extractormagicoderAsIs1SHOTfalsefalse520231225_100512__50600.011.80250[96, 386]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__AsIs__1SHOT__20231225_100512__506.json0.0missing{\n "num_gpu": 99\n}missing
10495Apple-MacBook-Pro-M1q_and_a_extractormagicoderAsIs1SHOTfalsefalse520231225_100518__86500.06.135350[96, 197]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__AsIs__1SHOT__20231225_100518__865.json0.0missing{\n "num_gpu": 99\n}missing
10496Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTfalsefalse520231214_083623__72900.020.6080[99, 590]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231214_083623__729.json0.0missingmissingmissing
10497Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231225_100452__82000.09.600362[99, 309]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231225_100452__820.json66.6667missing{\n "num_gpu": 99\n}missing
10498Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231225_100500__13600.08.274451[99, 265]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231225_100500__136.json58.3333missing{\n "num_gpu": 99\n}missing
10499Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231227_023242__22700.010.66371[99, 343]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231227_023242__227.json58.3333missing{\n "num_gpu": 99\n}missing
10500Apple-MacBook-Pro-M1q_and_a_extractormagicoderInJulia1SHOTtruetrue520231227_081747__47900.07.572622[99, 240]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__InJulia__1SHOT__20231227_081747__479.json66.6667missing{\n "num_gpu": 99\n}missing
10501Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTtruetrue520231214_083602__36100.02.722570[128, 59]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_083602__361.json50.0missingmissingmissing
10502Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTtruetrue520231225_100427__37100.012.17470[138, 384]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_100427__371.json50.0missing{\n "num_gpu": 99\n}missing
10503Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTfalsefalse520231225_100442__92500.014.37770[138, 454]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_100442__925.json0.0missing{\n "num_gpu": 99\n}missing
10504Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTtruetrue520231227_023231__14600.09.882322[138, 312]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_023231__146.json66.6667missing{\n "num_gpu": 99\n}missing
10505Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertAsk1SHOTfalsefalse520231227_081740__36900.07.641610[138, 236]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_081740__369.json0.0missing{\n "num_gpu": 99\n}missing
10506Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTtruetrue520231214_083559__84600.026.55450[229, 690]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083559__846.json50.0missingmissingmissing
10507Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTfalsefalse520231225_100406__54500.014.9670[239, 255]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100406__545.json0.0missing{\n "num_gpu": 99\n}missing
10508Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_100415__86400.08.991972[239, 262]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100415__864.json66.6667missing{\n "num_gpu": 99\n}missing
10509Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTfalsefalse520231227_023221__80300.014.82560[239, 267]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_023221__803.json0.0missing{\n "num_gpu": 99\n}missing
10510Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaExpertCoTTask1SHOTfalsefalse520231227_081732__29200.018.9850[239, 400]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081732__292.json0.0missing{\n "num_gpu": 99\n}missing
10511Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231214_083734__72900.029.43080[11, 767]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083734__729.json50.0missingmissingmissing
10512Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_100552__86200.014.18442[402, 398]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100552__862.json66.6667missing{\n "num_gpu": 99\n}missing
10513Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_100602__77000.09.706112[402, 259]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100602__770.json66.6667missing{\n "num_gpu": 99\n}missing
10514Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_081808__49900.08.517220[402, 217]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_081808__499.json50.0missing{\n "num_gpu": 99\n}missing
10515Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTtruetrue520231214_083704__95800.023.77420[399, 544]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_083704__958.json50.0missingmissingmissing
10516Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTtruetrue520231225_100528__66900.09.916062[399, 265]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_100528__669.json66.6667missing{\n "num_gpu": 99\n}missing
10517Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTtruetrue520231225_100538__65500.09.262513[399, 245]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_100538__655.json75.0missing{\n "num_gpu": 99\n}missing
10518Apple-MacBook-Pro-M1q_and_a_extractormagicoderJuliaRecapTask1SHOTfalsefalse520231227_081800__86900.012.5790[399, 344]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_081800__869.json0.0missing{\n "num_gpu": 99\n}missing
10519Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_182630__96800.020.11250[99, 373]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182630__968.json50.0missing{\n "num_gpu": 99\n}missing
10520Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_182647__64800.016.7943[99, 321]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182647__648.json75.0missing{\n "num_gpu": 99\n}missing
10521Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_182705__82000.017.81970[99, 341]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_182705__820.json50.0missing{\n "num_gpu": 99\n}missing
10522Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182534__86100.019.70713[138, 368]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182534__861.json75.0missing{\n "num_gpu": 99\n}missing
10523Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182550__30000.015.89220[138, 295]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182550__300.json50.0missing{\n "num_gpu": 99\n}missing
10524Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_182610__86400.019.63122[138, 366]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_182610__864.json66.6667missing{\n "num_gpu": 99\n}missing
10525Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_182441__30800.019.50050[239, 356]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182441__308.json0.0missing{\n "num_gpu": 99\n}missing
10526Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_182458__43600.017.09080[239, 302]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182458__436.json0.0missing{\n "num_gpu": 99\n}missing
10527Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182515__99200.016.89143[239, 302]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182515__992.json75.0missing{\n "num_gpu": 99\n}missing
10528Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182825__19500.030.7652[402, 525]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182825__195.json66.6667missing{\n "num_gpu": 99\n}missing
10529Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182844__65700.019.2243[402, 328]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182844__657.json75.0missing{\n "num_gpu": 99\n}missing
10530Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_182913__57500.028.42362[402, 501]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_182913__575.json66.6667missing{\n "num_gpu": 99\n}missing
10531Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182717__99700.011.99210[399, 191]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182717__997.json50.0missing{\n "num_gpu": 99\n}missing
10532Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182735__94900.017.37962[399, 294]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182735__949.json66.6667missing{\n "num_gpu": 99\n}missing
10533Apple-MacBook-Pro-M1q_and_a_extractormagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_182754__58000.019.20660[399, 328]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_182754__580.json50.0missing{\n "num_gpu": 99\n}missing
10534Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumAsIs1SHOTfalsefalse520231213_205457__16000.003522168.937380[94, 404]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__AsIs__1SHOT__20231213_205457__160.json0.0missingmissingmissing
10535Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumAsIs1SHOTfalsefalse520231225_230531__13500.0031095711.78270[94, 353]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__AsIs__1SHOT__20231225_230531__135.json0.0missingmissingmissing
10536Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumAsIs1SHOTfalsefalse520231225_230600__55400.0030933928.95070[94, 351]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__AsIs__1SHOT__20231225_230600__554.json0.0missingmissingmissing
10537Apple-MacBook-Pro-M1q_and_a_extractormistral-medium--optimAsIs1SHOTfalsefalse520231215_201623__72600.011.14910[94, 504]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__AsIs__1SHOT__20231215_201623__726.json0.00.9missing0.3
10538Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumInJulia1SHOTtruefalse520231213_205448__23100.0082790960.47320[97, 991]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__InJulia__1SHOT__20231213_205448__231.json25.0missingmissingmissing
10539Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumInJulia1SHOTtruefalse520231225_230454__29600.0046952217.30210[97, 548]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__InJulia__1SHOT__20231225_230454__296.json25.0missingmissingmissing
10540Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumInJulia1SHOTtruefalse520231225_230519__24400.0047680324.18930[97, 557]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__InJulia__1SHOT__20231225_230519__244.json25.0missingmissingmissing
10541Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumInJulia1SHOTtruefalse520231227_205441__80700.0042502723.23830[97, 493]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__InJulia__1SHOT__20231227_205441__807.json25.0missingmissingmissing
10542Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumInJulia1SHOTtruetrue520231227_205453__10100.0032471111.1882[97, 369]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__InJulia__1SHOT__20231227_205453__101.json66.6667missingmissingmissing
10543Apple-MacBook-Pro-M1q_and_a_extractormistral-medium--optimInJulia1SHOTtruefalse520231215_201612__22400.028.94750[97, 711]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__InJulia__1SHOT__20231215_201612__224.json25.00.9missing0.3
10544Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertAsk1SHOTtruefalse520231213_205348__69900.0048086120.53680[136, 549]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_205348__699.json25.0missingmissingmissing
10545Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_230427__35000.0051726624.00230[136, 594]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_230427__350.json25.0missingmissingmissing
10546Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertAsk1SHOTtruefalse520231225_230437__54800.0027861110.08680[136, 299]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_230437__548.json25.0missingmissingmissing
10547Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_205402__83200.0028103813.40050[136, 302]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_205402__832.json25.0missingmissingmissing
10548Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertAsk1SHOTtruefalse520231227_205418__22200.0045497315.72520[136, 517]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_205418__222.json25.0missingmissingmissing
10549Apple-MacBook-Pro-M1q_and_a_extractormistral-medium--optimJuliaExpertAsk1SHOTtruefalse520231215_201543__61600.08.330340[136, 375]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_201543__616.json25.00.9missing0.3
10550Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231213_205327__15000.0044017515.82880[237, 465]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_205327__150.json25.0missingmissingmissing
10551Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231225_230324__82900.0049680517.29840[237, 535]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230324__829.json25.0missingmissingmissing
10552Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231225_230403__22200.0062058238.26920[237, 688]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230403__222.json25.0missingmissingmissing
10553Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_205249__22700.0049761453.78450[237, 536]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205249__227.json50.0missingmissingmissing
10554Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaExpertCoTTask1SHOTtruefalse520231227_205349__90500.0055505359.38820[237, 607]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205349__905.json25.0missingmissingmissing
10555Apple-MacBook-Pro-M1q_and_a_extractormistral-medium--optimJuliaExpertCoTTask1SHOTtruefalse520231215_201534__88200.017.43740[237, 526]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201534__882.json25.00.9missing0.3
10556Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_205556__18800.0074764939.0733[399, 791]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_205556__188.json75.0missingmissingmissing
10557Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231225_230732__32600.0082207720.39860[399, 883]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230732__326.json25.0missingmissingmissing
10558Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_230752__86100.0048957819.54083[399, 472]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230752__861.json75.0missingmissingmissing
10559Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapCoTTask1SHOTtruefalse520231227_205608__87300.0056805129.04090[399, 569]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205608__873.json25.0missingmissingmissing
10560Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_205645__32000.0069749136.03813[399, 729]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205645__320.json75.0missingmissingmissing
10561Apple-MacBook-Pro-M1q_and_a_extractormistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_201716__61700.032.06493[399, 814]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201716__617.json75.00.9missing0.3
10562Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapTask1SHOTtruefalse520231213_205516__57700.0077191818.88920[396, 822]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_205516__577.json25.0missingmissingmissing
10563Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapTask1SHOTtruetrue520231225_230656__32000.0068211956.28583[396, 711]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_230656__320.json75.0missingmissingmissing
10564Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapTask1SHOTtruetrue520231225_230712__54400.0061982614.64140[396, 634]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_230712__544.json50.0missingmissingmissing
10565Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapTask1SHOTtruetrue520231227_205503__55600.0046126210.19963[396, 438]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_205503__556.json75.0missingmissingmissing
10566Apple-MacBook-Pro-M1q_and_a_extractormistral-mediumJuliaRecapTask1SHOTtruefalse520231227_205539__28500.0088679635.20040[396, 964]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_205539__285.json25.0missingmissingmissing
10567Apple-MacBook-Pro-M1q_and_a_extractormistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_201644__74900.021.02182[396, 913]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_201644__749.json66.66670.9missing0.3
10568Apple-MacBook-Pro-M1q_and_a_extractormistral-smallAsIs1SHOTfalsefalse520231213_205253__97500.0008814395.631540[97, 422]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__AsIs__1SHOT__20231213_205253__975.json0.0missingmissingmissing
10569Apple-MacBook-Pro-M1q_and_a_extractormistral-smallAsIs1SHOTfalsefalse520231225_230231__68000.0001131990.5278590[97, 26]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__AsIs__1SHOT__20231225_230231__680.json0.0missingmissingmissing
10570Apple-MacBook-Pro-M1q_and_a_extractormistral-smallAsIs1SHOTfalsefalse520231225_230237__19500.0008969595.882790[97, 430]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__AsIs__1SHOT__20231225_230237__195.json0.0missingmissingmissing
10571Apple-MacBook-Pro-M1q_and_a_extractormistral-small--optimAsIs1SHOTfalsefalse520231215_201504__79400.03.799750[97, 285]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__AsIs__1SHOT__20231215_201504__794.json0.00.9missing0.3
10572Apple-MacBook-Pro-M1q_and_a_extractormistral-smallInJulia1SHOTtruetrue520231213_205247__80200.000935765.957860[100, 449]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__InJulia__1SHOT__20231213_205247__802.json50.0missingmissingmissing
10573Apple-MacBook-Pro-M1q_and_a_extractormistral-smallInJulia1SHOTtruetrue520231225_230223__53000.000960986.199063[100, 462]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__InJulia__1SHOT__20231225_230223__530.json75.0missingmissingmissing
10574Apple-MacBook-Pro-M1q_and_a_extractormistral-smallInJulia1SHOTtruetrue520231225_230231__41100.001001726.511220[100, 483]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__InJulia__1SHOT__20231225_230231__411.json50.0missingmissingmissing
10575Apple-MacBook-Pro-M1q_and_a_extractormistral-smallInJulia1SHOTtruetrue520231227_205120__11700.00106386.892361[100, 515]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__InJulia__1SHOT__20231227_205120__117.json58.3333missingmissingmissing
10576Apple-MacBook-Pro-M1q_and_a_extractormistral-smallInJulia1SHOTtruetrue520231227_205127__29300.001075447.088023[100, 521]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__InJulia__1SHOT__20231227_205127__293.json75.0missingmissingmissing
10577Apple-MacBook-Pro-M1q_and_a_extractormistral-small--optimInJulia1SHOTtruetrue520231215_201500__42500.08.684223[100, 525]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__InJulia__1SHOT__20231215_201500__425.json75.00.9missing0.3
10578Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertAsk1SHOTtruetrue520231213_205241__98100.0006577073.934371[141, 292]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_205241__981.json58.3333missingmissingmissing
10579Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertAsk1SHOTtruetrue520231225_230210__78300.0005432473.323633[141, 233]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_230210__783.json75.0missingmissingmissing
10580Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertAsk1SHOTtruetrue520231225_230217__61200.001020496.431453[141, 479]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_230217__612.json75.0missingmissingmissing
10581Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertAsk1SHOTtruetrue520231227_205106__71900.0007682875.15781[141, 349]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_205106__719.json58.3333missingmissingmissing
10582Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertAsk1SHOTtruetrue520231227_205113__35000.001036016.589571[141, 487]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_205113__350.json58.3333missingmissingmissing
10583Apple-MacBook-Pro-M1q_and_a_extractormistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_201451__67800.03.795551[141, 284]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_201451__678.json58.33330.9missing0.3
10584Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertCoTTask1SHOTfalsefalse520231213_205237__49700.0003214741.263060[242, 85]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_205237__497.json0.0missingmissingmissing
10585Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_230202__99400.0008685545.09880[242, 367]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230202__994.json50.0missingmissingmissing
10586Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_230207__87500.0008510944.92880[242, 358]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230207__875.json50.0missingmissingmissing
10587Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_205055__77500.0008995945.268170[242, 383]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205055__775.json50.0missingmissingmissing
10588Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_205101__71900.0009345145.510943[242, 401]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205101__719.json75.0missingmissingmissing
10589Apple-MacBook-Pro-M1q_and_a_extractormistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_201447__26100.07.829350[242, 586]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201447__261.json50.00.9missing0.3
10590Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_205311__24100.001289597.177223[407, 529]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_205311__241.json75.0missingmissingmissing
10591Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_230305__69600.001223636.742862[407, 495]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230305__696.json66.6667missingmissingmissing
10592Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapCoTTask1SHOTfalsefalse520231225_230307__66400.0004398691.450960[407, 91]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230307__664.json0.0missingmissingmissing
10593Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapCoTTask1SHOTtruefalse520231227_205153__97300.001580599.334980[407, 679]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205153__973.json25.0missingmissingmissing
10594Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapCoTTask1SHOTfalsefalse520231227_205155__80400.0005446292.118070[407, 145]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205155__804.json0.0missingmissingmissing
10595Apple-MacBook-Pro-M1q_and_a_extractormistral-small--optimJuliaRecapCoTTask1SHOTtruetrue520231215_201516__81000.05.947713[407, 444]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201516__810.json75.00.9missing0.3
10596Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapTask1SHOTfalsefalse520231213_205304__59200.0017364410.35240[405, 760]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_205304__592.json0.0missingmissingmissing
10597Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapTask1SHOTtruefalse520231225_230245__77400.001362017.848850[405, 567]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_230245__774.json25.0missingmissingmissing
10598Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapTask1SHOTfalsefalse520231225_230258__77300.0020216212.58040[405, 907]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_230258__773.json0.0missingmissingmissing
10599Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapTask1SHOTfalsefalse520231227_205135__42600.001412458.023490[405, 593]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_205135__426.json0.0missingmissingmissing
10600Apple-MacBook-Pro-M1q_and_a_extractormistral-smallJuliaRecapTask1SHOTtruetrue520231227_205143__25600.001406638.024852[405, 590]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_205143__256.json66.6667missingmissingmissing
10601Apple-MacBook-Pro-M1q_and_a_extractormistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_201510__44800.05.926323[405, 438]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_201510__448.json75.00.9missing0.3
10602Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyAsIs1SHOTfalsefalse520231213_205216__77500.0001861736.335480[97, 381]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__AsIs__1SHOT__20231213_205216__775.json0.0missingmissingmissing
10603Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyAsIs1SHOTfalsefalse520231225_230130__22900.000190253.394540[97, 390]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__AsIs__1SHOT__20231225_230130__229.json0.0missingmissingmissing
10604Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyAsIs1SHOTfalsefalse520231225_230134__28000.0002097293.852970[97, 433]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__AsIs__1SHOT__20231225_230134__280.json0.0missingmissingmissing
10605Apple-MacBook-Pro-M1q_and_a_extractormistral-tiny--optimAsIs1SHOTfalsefalse520231215_201431__71300.02.380310[97, 282]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__AsIs__1SHOT__20231215_201431__713.json0.00.9missing0.3
10606Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyInJulia1SHOTtruetrue520231213_205210__32500.00030256110.94690[100, 637]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__InJulia__1SHOT__20231213_205210__325.json50.0missingmissingmissing
10607Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyInJulia1SHOTtruetrue520231225_230122__82700.0002867065.276220[100, 602]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__InJulia__1SHOT__20231225_230122__827.json50.0missingmissingmissing
10608Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyInJulia1SHOTtruetrue520231225_230127__91900.0002717574.917793[100, 569]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__InJulia__1SHOT__20231225_230127__919.json75.0missingmissingmissing
10609Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyInJulia1SHOTtruetrue520231227_205022__31100.0002518254.718342[100, 525]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__InJulia__1SHOT__20231227_205022__311.json66.6667missingmissingmissing
10610Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyInJulia1SHOTtruetrue520231227_205027__89000.0002531844.715613[100, 528]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__InJulia__1SHOT__20231227_205027__890.json75.0missingmissingmissing
10611Apple-MacBook-Pro-M1q_and_a_extractormistral-tiny--optimInJulia1SHOTfalsefalse520231215_201428__82300.04.47290[100, 540]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__InJulia__1SHOT__20231215_201428__823.json0.00.9missing0.3
10612Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertAsk1SHOTfalsefalse520231213_205159__80100.0001542815.463530[141, 297]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_205159__801.json0.0missingmissingmissing
10613Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertAsk1SHOTfalsefalse520231225_230112__41800.0001705892.923140[141, 333]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_230112__418.json0.0missingmissingmissing
10614Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_230116__20700.000232654.195880[141, 470]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_230116__207.json50.0missingmissingmissing
10615Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_205014__88900.0001846323.262410[141, 364]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_205014__889.json50.0missingmissingmissing
10616Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertAsk1SHOTfalsefalse520231227_205017__38200.0001352552.343730[141, 255]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_205017__382.json0.0missingmissingmissing
10617Apple-MacBook-Pro-M1q_and_a_extractormistral-tiny--optimJuliaExpertAsk1SHOTfalsefalse520231215_201424__60400.03.085980[141, 359]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_201424__604.json0.00.9missing0.3
10618Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231213_205153__56300.0001888067.120341[242, 342]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_205153__563.json58.3333missingmissingmissing
10619Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231225_230104__71100.0002581159.088880[242, 495]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230104__711.json25.0missingmissingmissing
10620Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertCoTTask1SHOTfalsefalse520231225_230109__40300.0002495084.369310[242, 476]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230109__403.json0.0missingmissingmissing
10621Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_205008__52200.0001915249.618560[242, 348]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205008__522.json50.0missingmissingmissing
10622Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaExpertCoTTask1SHOTtruefalse520231227_205011__69300.0001811053.052430[242, 325]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205011__693.json25.0missingmissingmissing
10623Apple-MacBook-Pro-M1q_and_a_extractormistral-tiny--optimJuliaExpertCoTTask1SHOTtruefalse520231215_201420__83300.05.54490[242, 426]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201420__833.json25.00.9missing0.3
10624Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapCoTTask1SHOTtruefalse520231213_205236__52200.00040714913.79660[407, 773]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_205236__522.json25.0missingmissingmissing
10625Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapCoTTask1SHOTfalsefalse520231225_230151__67600.0004008076.707560[407, 759]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230151__676.json0.0missingmissingmissing
10626Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_230156__95700.0003328575.510920[407, 609]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230156__957.json50.0missingmissingmissing
10627Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_205044__71000.0004207397.618650[407, 803]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205044__710.json50.0missingmissingmissing
10628Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapCoTTask1SHOTtruefalse520231227_205050__17700.0003097545.191980[407, 558]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205050__177.json25.0missingmissingmissing
10629Apple-MacBook-Pro-M1q_and_a_extractormistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_201439__75800.05.159441[407, 592]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201439__758.json58.33330.9missing0.3
10630Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapTask1SHOTtruetrue520231213_205222__74800.0002102675.588671[405, 339]0.10.0-DEV31.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_205222__748.json58.3333missingmissingmissing
10631Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapTask1SHOTfalsefalse520231225_230141__38700.0003864846.444020[405, 728]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_230141__387.json0.0missingmissingmissing
10632Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapTask1SHOTtruetrue520231225_230144__24100.0002143443.13932[405, 348]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_230144__241.json66.6667missingmissingmissing
10633Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapTask1SHOTfalsefalse520231227_205031__84700.0002542084.065940[405, 436]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_205031__847.json0.0missingmissingmissing
10634Apple-MacBook-Pro-M1q_and_a_extractormistral-tinyJuliaRecapTask1SHOTtruetrue520231227_205037__92100.0003280475.622550[405, 599]0.10.0-DEV31.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_205037__921.json50.0missingmissingmissing
10635Apple-MacBook-Pro-M1q_and_a_extractormistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_201434__91800.03.108051[405, 354]0.10.0-DEV31.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_201434__918.json58.33330.9missing0.3
10636Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_113131__90000.05.286490[96, 126]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_113131__900.json0.0missing{\n "num_gpu": 99\n}missing
10637Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_113137__35100.06.581090[96, 160]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_113137__351.json0.0missing{\n "num_gpu": 99\n}missing
10638Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MInJulia1SHOTtruefalse520231225_113118__58000.011.2290[99, 277]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_113118__580.json25.0missing{\n "num_gpu": 99\n}missing
10639Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MInJulia1SHOTfalsefalse520231225_113125__85300.07.464620[99, 179]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_113125__853.json0.0missing{\n "num_gpu": 99\n}missing
10640Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_083442__53700.011.29861[99, 277]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_083442__537.json58.3333missing{\n "num_gpu": 99\n}missing
10641Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_113057__87200.06.261220[140, 143]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113057__872.json0.0missing{\n "num_gpu": 99\n}missing
10642Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_113106__81300.09.714460[140, 232]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113106__813.json50.0missing{\n "num_gpu": 99\n}missing
10643Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_083431__27000.07.608790[140, 177]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_083431__270.json0.0missing{\n "num_gpu": 99\n}missing
10644Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_113035__16000.023.90991[241, 435]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113035__160.json58.3333missing{\n "num_gpu": 99\n}missing
10645Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_113050__20700.014.88130[241, 348]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113050__207.json0.0missing{\n "num_gpu": 99\n}missing
10646Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_083423__11800.016.68180[241, 257]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083423__118.json0.0missing{\n "num_gpu": 99\n}missing
10647Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231225_113218__49300.09.436580[407, 185]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113218__493.json0.0missing{\n "num_gpu": 99\n}missing
10648Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113235__28600.017.57260[407, 388]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113235__286.json50.0missing{\n "num_gpu": 99\n}missing
10649Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_083506__27800.08.580930[407, 163]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083506__278.json0.0missing{\n "num_gpu": 99\n}missing
10650Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_113149__36700.011.45880[405, 236]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113149__367.json50.0missing{\n "num_gpu": 99\n}missing
10651Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_113208__11200.019.35890[405, 432]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113208__112.json0.0missing{\n "num_gpu": 99\n}missing
10652Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_083457__62900.014.7730[405, 317]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083457__629.json50.0missing{\n "num_gpu": 99\n}missing
10653Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002741__82700.017.19140[98, 538]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002741__827.json50.0missing{\n "num_gpu": 99\n}missing
10654Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse520231228_002758__19200.016.46420[98, 515]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002758__192.json25.0missing{\n "num_gpu": 99\n}missing
10655Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002811__71300.012.85353[98, 400]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002811__713.json75.0missing{\n "num_gpu": 99\n}missing
10656Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTfalsefalse520231228_002829__92800.018.13380[98, 567]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002829__928.json0.0missing{\n "num_gpu": 99\n}missing
10657Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_002851__62400.021.62340[98, 675]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_002851__624.json50.0missing{\n "num_gpu": 99\n}missing
10658Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_002644__58500.06.81263[139, 200]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002644__585.json75.0missing{\n "num_gpu": 99\n}missing
10659Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_002653__49200.08.47742[139, 255]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002653__492.json66.6667missing{\n "num_gpu": 99\n}missing
10660Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_002703__11100.010.6410[139, 324]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002703__111.json0.0missing{\n "num_gpu": 99\n}missing
10661Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_002715__35200.011.15553[139, 341]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002715__352.json75.0missing{\n "num_gpu": 99\n}missing
10662Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTfalsefalse520231228_002724__21400.09.273230[139, 280]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_002724__214.json0.0missing{\n "num_gpu": 99\n}missing
10663Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_002528__71900.016.89280[240, 476]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002528__719.json0.0missing{\n "num_gpu": 99\n}missing
10664Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_002546__69200.017.83620[240, 530]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002546__692.json25.0missing{\n "num_gpu": 99\n}missing
10665Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_002600__21300.013.25340[240, 389]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002600__213.json50.0missing{\n "num_gpu": 99\n}missing
10666Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_002614__85900.014.21130[240, 418]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002614__859.json50.0missing{\n "num_gpu": 99\n}missing
10667Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTfalsefalse520231228_002637__76300.022.84150[240, 681]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_002637__763.json0.0missing{\n "num_gpu": 99\n}missing
10668Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003106__96300.019.55051[406, 547]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003106__963.json58.3333missing{\n "num_gpu": 99\n}missing
10669Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003125__33500.018.39740[406, 512]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003125__335.json50.0missing{\n "num_gpu": 99\n}missing
10670Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTfalsefalse520231228_003148__40700.022.82960[406, 644]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003148__407.json0.0missing{\n "num_gpu": 99\n}missing
10671Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_003204__58200.016.7890[406, 465]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003204__582.json25.0missing{\n "num_gpu": 99\n}missing
10672Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_003232__96900.027.00760[406, 765]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003232__969.json50.0missing{\n "num_gpu": 99\n}missing
10673Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_002914__32000.022.48061[404, 634]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_002914__320.json58.3333missing{\n "num_gpu": 99\n}missing
10674Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_002946__25600.031.79540[404, 900]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_002946__256.json50.0missing{\n "num_gpu": 99\n}missing
10675Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231228_003006__58200.019.79440[404, 554]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_003006__582.json0.0missing{\n "num_gpu": 99\n}missing
10676Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTfalsefalse520231228_003032__84900.026.56270[404, 752]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_003032__849.json0.0missing{\n "num_gpu": 99\n}missing
10677Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_003046__30200.014.02320[404, 381]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_003046__302.json50.0missing{\n "num_gpu": 99\n}missing
10678Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruefalse520231228_003545__71800.016.46360[98, 407]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003545__718.json25.0missing{\n "num_gpu": 99\n}missing
10679Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_003604__68900.018.9360[98, 469]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003604__689.json0.0missing{\n "num_gpu": 99\n}missing
10680Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse520231228_003630__10700.025.47260[98, 631]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003630__107.json0.0missing{\n "num_gpu": 99\n}missing
10681Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_003651__69000.021.2190[98, 526]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003651__690.json50.0missing{\n "num_gpu": 99\n}missing
10682Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_003708__48800.016.61650[98, 411]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_003708__488.json50.0missing{\n "num_gpu": 99\n}missing
10683Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_003422__17000.012.13970[139, 292]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003422__170.json50.0missing{\n "num_gpu": 99\n}missing
10684Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231228_003446__36300.023.54760[139, 577]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003446__363.json0.0missing{\n "num_gpu": 99\n}missing
10685Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_003506__39600.020.45883[139, 501]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003506__396.json75.0missing{\n "num_gpu": 99\n}missing
10686Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_003518__24000.011.41060[139, 273]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003518__240.json50.0missing{\n "num_gpu": 99\n}missing
10687Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231228_003529__98800.010.41520[139, 248]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_003529__988.json0.0missing{\n "num_gpu": 99\n}missing
10688Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_003252__14300.020.11840[240, 454]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003252__143.json25.0missing{\n "num_gpu": 99\n}missing
10689Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_003308__34900.016.20482[240, 378]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003308__349.json66.6667missing{\n "num_gpu": 99\n}missing
10690Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_003330__98400.021.11890[240, 499]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003330__984.json0.0missing{\n "num_gpu": 99\n}missing
10691Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_003354__41000.024.01770[240, 570]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003354__410.json50.0missing{\n "num_gpu": 99\n}missing
10692Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231228_003410__73600.015.88980[240, 370]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_003410__736.json25.0missing{\n "num_gpu": 99\n}missing
10693Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231228_003943__14600.034.78830[406, 792]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003943__146.json0.0missing{\n "num_gpu": 99\n}missing
10694Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231228_003958__51800.015.60940[406, 336]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_003958__518.json25.0missing{\n "num_gpu": 99\n}missing
10695Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_004041__88200.042.15350[406, 960]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004041__882.json50.0missing{\n "num_gpu": 99\n}missing
10696Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_004100__36700.019.15910[406, 422]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004100__367.json50.0missing{\n "num_gpu": 99\n}missing
10697Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_004119__23500.018.66710[406, 410]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004119__235.json50.0missing{\n "num_gpu": 99\n}missing
10698Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_003727__94100.018.66750[404, 410]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003727__941.json0.0missing{\n "num_gpu": 99\n}missing
10699Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_003758__40000.031.29240[404, 711]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003758__400.json50.0missing{\n "num_gpu": 99\n}missing
10700Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_003818__11600.020.58670[404, 457]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003818__116.json0.0missing{\n "num_gpu": 99\n}missing
10701Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_003836__15000.017.45451[404, 381]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003836__150.json58.3333missing{\n "num_gpu": 99\n}missing
10702Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTfalsefalse520231228_003908__12300.031.80390[404, 723]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_003908__123.json0.0missing{\n "num_gpu": 99\n}missing
10703Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_123837__99900.025.72760[95, 468]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_123837__999.json0.0missing{\n "num_gpu": 99\n}missing
10704Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_123853__17400.016.02260[95, 291]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_123853__174.json0.0missing{\n "num_gpu": 99\n}missing
10705Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruefalse520231226_123720__31200.020.69020[98, 370]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123720__312.json25.0missing{\n "num_gpu": 99\n}missing
10706Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231226_123811__47900.050.65220[98, 904]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_123811__479.json0.0missing{\n "num_gpu": 99\n}missing
10707Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KInJulia1SHOTfalsefalse520231227_083854__93600.030.22740[98, 552]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_083854__936.json0.0missing{\n "num_gpu": 99\n}missing
10708Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_123643__21300.016.45890[139, 293]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123643__213.json50.0missing{\n "num_gpu": 99\n}missing
10709Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_123659__12900.016.62430[139, 295]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_123659__129.json50.0missing{\n "num_gpu": 99\n}missing
10710Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_083824__71100.024.32540[139, 439]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_083824__711.json50.0missing{\n "num_gpu": 99\n}missing
10711Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231226_123558__23100.018.76530[240, 318]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123558__231.json0.0missing{\n "num_gpu": 99\n}missing
10712Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_123626__72000.028.09381[240, 485]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_123626__720.json58.3333missing{\n "num_gpu": 99\n}missing
10713Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_083759__90300.028.80191[240, 348]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083759__903.json58.3333missing{\n "num_gpu": 99\n}missing
10714Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_124027__81200.028.42960[406, 473]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124027__812.json50.0missing{\n "num_gpu": 99\n}missing
10715Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_124056__36200.028.35950[406, 469]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124056__362.json25.0missing{\n "num_gpu": 99\n}missing
10716Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_084016__30700.039.44330[406, 673]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084016__307.json50.0missing{\n "num_gpu": 99\n}missing
10717Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_123914__64800.021.03672[404, 346]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123914__648.json66.6667missing{\n "num_gpu": 99\n}missing
10718Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_123959__42600.044.73430[404, 744]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_123959__426.json50.0missing{\n "num_gpu": 99\n}missing
10719Apple-MacBook-Pro-M1q_and_a_extractormistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_083936__66800.042.46740[404, 726]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_083936__668.json0.0missing{\n "num_gpu": 99\n}missing
10720Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_084450__96600.062.92220[104, 367]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_084450__966.json50.0missing{\n "num_gpu": 99\n}missing
10721Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_130656__36900.078.48123[104, 460]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_130656__369.json75.0missing{\n "num_gpu": 99\n}missing
10722Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_130821__42000.084.45540[104, 496]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_130821__420.json50.0missing{\n "num_gpu": 99\n}missing
10723Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_130929__14500.068.35893[104, 400]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_130929__145.json75.0missing{\n "num_gpu": 99\n}missing
10724Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_084347__35100.031.5343[143, 171]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_084347__351.json75.0missing{\n "num_gpu": 99\n}missing
10725Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_130350__58400.045.3340[143, 254]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_130350__584.json0.0missing{\n "num_gpu": 99\n}missing
10726Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_130500__82700.070.1530[143, 398]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_130500__827.json50.0missing{\n "num_gpu": 99\n}missing
10727Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_130537__69600.037.09320[143, 203]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_130537__696.json0.0missing{\n "num_gpu": 99\n}missing
10728Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_084316__51200.0139.0650[244, 652]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084316__512.json50.0missing{\n "num_gpu": 99\n}missing
10729Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_130024__97000.0107.1772[244, 540]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_130024__970.json66.6667missing{\n "num_gpu": 99\n}missing
10730Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_130129__81000.065.30520[244, 343]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_130129__810.json50.0missing{\n "num_gpu": 99\n}missing
10731Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_130304__38400.094.42541[244, 525]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_130304__384.json58.3333missing{\n "num_gpu": 99\n}missing
10732Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_084603__74800.011.70220[417, 4]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084603__748.json0.0missing{\n "num_gpu": 99\n}missing
10733Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_131547__74300.0108.1620[417, 570]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_131547__743.json50.0missing{\n "num_gpu": 99\n}missing
10734Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_131830__31800.012.17040[417, 5]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_131830__318.json0.0missing{\n "num_gpu": 99\n}missing
10735Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_084551__82700.060.44460[415, 297]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_084551__827.json50.0missing{\n "num_gpu": 99\n}missing
10736Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_131129__94100.0119.6893[415, 639]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_131129__941.json75.0missing{\n "num_gpu": 99\n}missing
10737Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse520231227_131254__68300.084.94120[415, 440]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_131254__683.json0.0missing{\n "num_gpu": 99\n}missing
10738Apple-MacBook-Pro-M1q_and_a_extractornous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_131359__72300.064.46890[415, 321]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_131359__723.json50.0missing{\n "num_gpu": 99\n}missing
10739Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_113416__87600.010.11740[104, 247]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_113416__876.json0.0missing{\n "num_gpu": 99\n}missing
10740Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_113421__38800.04.685960[104, 106]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_113421__388.json0.0missing{\n "num_gpu": 99\n}missing
10741Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTfalsefalse520231225_113346__10300.016.23120[107, 404]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_113346__103.json0.0missing{\n "num_gpu": 99\n}missing
10742Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_113406__58200.019.66711[107, 491]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_113406__582.json58.3333missing{\n "num_gpu": 99\n}missing
10743Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_083546__83300.013.36850[107, 329]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_083546__833.json50.0missing{\n "num_gpu": 99\n}missing
10744Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_113322__74300.011.24480[148, 271]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113322__743.json50.0missing{\n "num_gpu": 99\n}missing
10745Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_113329__72900.07.540251[148, 176]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_113329__729.json58.3333missing{\n "num_gpu": 99\n}missing
10746Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_083532__43800.09.451030[148, 224]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_083532__438.json50.0missing{\n "num_gpu": 99\n}missing
10747Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_113253__73300.017.93690[249, 259]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113253__733.json0.0missing{\n "num_gpu": 99\n}missing
10748Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_113311__60000.017.35322[249, 409]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113311__600.json66.6667missing{\n "num_gpu": 99\n}missing
10749Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_083523__90700.016.74130[249, 243]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083523__907.json0.0missing{\n "num_gpu": 99\n}missing
10750Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113517__44300.018.00912[415, 397]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113517__443.json66.6667missing{\n "num_gpu": 99\n}missing
10751Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113528__11200.010.97232[415, 223]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113528__112.json66.6667missing{\n "num_gpu": 99\n}missing
10752Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_083621__18300.017.60332[415, 385]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083621__183.json66.6667missing{\n "num_gpu": 99\n}missing
10753Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_113441__47400.020.63633[413, 462]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113441__474.json75.0missing{\n "num_gpu": 99\n}missing
10754Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_113459__10800.017.71180[413, 390]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_113459__108.json50.0missing{\n "num_gpu": 99\n}missing
10755Apple-MacBook-Pro-M1q_and_a_extractoropenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_083603__57800.017.46452[413, 382]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083603__578.json66.6667missing{\n "num_gpu": 99\n}missing
10756Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_082710__36200.013.50130[82, 397]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_082710__362.json0.0missingmissingmissing
10757Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_094112__93500.06.34830[102, 196]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_094112__935.json0.0missing{\n "num_gpu": 99\n}missing
10758Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_094121__81600.09.228510[102, 293]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_094121__816.json0.0missing{\n "num_gpu": 99\n}missing
10759Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231214_082657__30000.017.47220[99, 504]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_082657__300.json50.0missingmissingmissing
10760Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231225_094055__72800.08.922610[105, 282]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_094055__728.json50.0missing{\n "num_gpu": 99\n}missing
10761Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruefalse520231225_094106__10600.010.32150[105, 329]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_094106__106.json25.0missing{\n "num_gpu": 99\n}missing
10762Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231227_022255__49800.012.43753[105, 395]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_022255__498.json75.0missing{\n "num_gpu": 99\n}missing
10763Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralInJulia1SHOTtruetrue520231227_080715__49100.017.13031[105, 543]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_080715__491.json58.3333missing{\n "num_gpu": 99\n}missing
10764Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTfalsefalse520231214_082639__85300.019.28660[128, 545]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_082639__853.json0.0missingmissingmissing
10765Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_094035__15500.010.45090[146, 327]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_094035__155.json50.0missing{\n "num_gpu": 99\n}missing
10766Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_094046__80700.010.33842[146, 324]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_094046__807.json66.6667missing{\n "num_gpu": 99\n}missing
10767Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_022242__91100.08.538433[146, 261]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_022242__911.json75.0missing{\n "num_gpu": 99\n}missing
10768Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_080658__43700.014.54291[146, 454]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_080658__437.json58.3333missing{\n "num_gpu": 99\n}missing
10769Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231214_082620__50600.019.46110[229, 507]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082620__506.json50.0missingmissingmissing
10770Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_094010__90200.019.42560[247, 423]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094010__902.json50.0missing{\n "num_gpu": 99\n}missing
10771Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231225_094025__74600.014.323[247, 433]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094025__746.json75.0missing{\n "num_gpu": 99\n}missing
10772Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_022234__68100.018.71570[247, 411]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022234__681.json50.0missing{\n "num_gpu": 99\n}missing
10773Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_080643__33800.021.65273[247, 497]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_080643__338.json75.0missing{\n "num_gpu": 99\n}missing
10774Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruefalse520231214_082800__69100.020.97630[11, 562]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_082800__691.json25.0missingmissingmissing
10775Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_094159__79700.013.51813[413, 375]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094159__797.json75.0missing{\n "num_gpu": 99\n}missing
10776Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_094213__41700.013.80421[413, 383]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094213__417.json58.3333missing{\n "num_gpu": 99\n}missing
10777Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_022319__68800.012.61550[413, 344]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022319__688.json50.0missing{\n "num_gpu": 99\n}missing
10778Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_080741__25800.010.90033[413, 290]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_080741__258.json75.0missing{\n "num_gpu": 99\n}missing
10779Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231214_082739__90200.028.78070[399, 668]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_082739__902.json25.0missingmissingmissing
10780Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruefalse520231225_094132__92700.011.15010[411, 300]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_094132__927.json25.0missing{\n "num_gpu": 99\n}missing
10781Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse520231225_094145__12700.012.86710[411, 355]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_094145__127.json0.0missing{\n "num_gpu": 99\n}missing
10782Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_022307__61800.011.70940[411, 316]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_022307__618.json50.0missing{\n "num_gpu": 99\n}missing
10783Apple-MacBook-Pro-M1q_and_a_extractoropenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_080730__53000.015.1643[411, 422]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_080730__530.json75.0missing{\n "num_gpu": 99\n}missing
10784Apple-MacBook-Pro-M1q_and_a_extractororca2:13bAsIs1SHOTfalsefalse520231214_084018__86600.014.7810[82, 434]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__AsIs__1SHOT__20231214_084018__866.json0.0missingmissingmissing
10785Apple-MacBook-Pro-M1q_and_a_extractororca2:13bAsIs1SHOTfalsefalse520231225_101048__57500.029.30490[99, 528]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__AsIs__1SHOT__20231225_101048__575.json0.0missing{\n "num_gpu": 99\n}missing
10786Apple-MacBook-Pro-M1q_and_a_extractororca2:13bAsIs1SHOTfalsefalse520231225_101102__17100.013.74790[99, 244]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__AsIs__1SHOT__20231225_101102__171.json0.0missing{\n "num_gpu": 99\n}missing
10787Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTtruetrue520231214_084003__40200.017.520[99, 505]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231214_084003__402.json50.0missingmissingmissing
10788Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTfalsefalse520231225_100953__27600.022.68050[102, 408]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231225_100953__276.json0.0missing{\n "num_gpu": 99\n}missing
10789Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTfalsefalse520231225_101019__22600.025.55950[102, 455]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231225_101019__226.json0.0missing{\n "num_gpu": 99\n}missing
10790Apple-MacBook-Pro-M1q_and_a_extractororca2:13bInJulia1SHOTtruefalse520231227_082015__67900.026.68580[102, 469]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__InJulia__1SHOT__20231227_082015__679.json25.0missing{\n "num_gpu": 99\n}missing
10791Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTtruetrue520231214_083945__98900.07.99130[128, 222]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_083945__989.json50.0missingmissingmissing
10792Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTtruetrue520231225_100858__87100.028.16942[141, 500]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_100858__871.json66.6667missing{\n "num_gpu": 99\n}missing
10793Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_100931__39200.032.60330[141, 578]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_100931__392.json0.0missing{\n "num_gpu": 99\n}missing
10794Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertAsk1SHOTfalsefalse520231227_081948__67900.018.7190[141, 327]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_081948__679.json0.0missing{\n "num_gpu": 99\n}missing
10795Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_083937__59200.026.45450[229, 687]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083937__592.json50.0missingmissingmissing
10796Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_100807__28700.032.53092[242, 389]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100807__287.json66.6667missing{\n "num_gpu": 99\n}missing
10797Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_100830__50200.022.55452[242, 379]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100830__502.json66.6667missing{\n "num_gpu": 99\n}missing
10798Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231227_081930__71400.030.86780[242, 356]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081930__714.json0.0missing{\n "num_gpu": 99\n}missing
10799Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTtruefalse520231214_084107__15000.026.01850[11, 686]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084107__150.json25.0missingmissingmissing
10800Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_101233__43600.029.83270[405, 475]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_101233__436.json0.0missing{\n "num_gpu": 99\n}missing
10801Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTfalsefalse520231225_101241__73800.08.500610[405, 96]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_101241__738.json0.0missing{\n "num_gpu": 99\n}missing
10802Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapCoTTask1SHOTtruetrue520231227_082125__49900.035.4591[405, 550]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_082125__499.json58.3333missing{\n "num_gpu": 99\n}missing
10803Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTfalsefalse520231214_084041__58100.022.97240[399, 524]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_084041__581.json0.0missingmissingmissing
10804Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTfalsefalse520231225_101127__97900.025.07310[402, 393]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_101127__979.json0.0missing{\n "num_gpu": 99\n}missing
10805Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTtruetrue520231225_101203__73900.035.82290[402, 578]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_101203__739.json50.0missing{\n "num_gpu": 99\n}missing
10806Apple-MacBook-Pro-M1q_and_a_extractororca2:13bJuliaRecapTask1SHOTtruetrue520231227_082049__63400.034.09510[402, 540]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_082049__634.json50.0missing{\n "num_gpu": 99\n}missing
10807Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_113748__36500.018.58630[93, 702]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_113748__365.json0.0missing{\n "num_gpu": 99\n}missing
10808Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_113811__99000.022.38880[93, 835]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_113811__990.json0.0missing{\n "num_gpu": 99\n}missing
10809Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_113705__59100.028.74920[96, 1049]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_113705__591.json0.0missing{\n "num_gpu": 99\n}missing
10810Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_113730__41800.024.68020[96, 913]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_113730__418.json0.0missing{\n "num_gpu": 99\n}missing
10811Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_083714__75500.032.55320[96, 1165]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_083714__755.json0.0missing{\n "num_gpu": 99\n}missing
10812Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_113617__37700.042.21060[133, 1463]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_113617__377.json0.0missing{\n "num_gpu": 99\n}missing
10813Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_113636__35600.018.98120[133, 704]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_113636__356.json0.0missing{\n "num_gpu": 99\n}missing
10814Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_083642__66400.015.83990[133, 588]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_083642__664.json0.0missing{\n "num_gpu": 99\n}missing
10815Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_113534__12200.05.196150[232, 31]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113534__122.json0.0missing{\n "num_gpu": 99\n}missing
10816Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_113535__49300.01.192060[232, 19]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_113535__493.json0.0missing{\n "num_gpu": 99\n}missing
10817Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_083626__11300.04.567070[232, 14]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083626__113.json0.0missing{\n "num_gpu": 99\n}missing
10818Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_113834__67600.07.578780[385, 237]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113834__676.json0.0missing{\n "num_gpu": 99\n}missing
10819Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_113842__40600.08.434510[385, 268]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113842__406.json0.0missing{\n "num_gpu": 99\n}missing
10820Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_083730__70200.07.774040[385, 242]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083730__702.json0.0missing{\n "num_gpu": 99\n}missing
10821Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_113821__88900.010.36040[382, 342]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_113821__889.json0.0missing{\n "num_gpu": 99\n}missing
10822Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_113826__91100.05.174620[382, 151]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_113826__911.json0.0missing{\n "num_gpu": 99\n}missing
10823Apple-MacBook-Pro-M1q_and_a_extractorphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231227_083722__62100.08.221050[382, 262]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_083722__621.json0.0missing{\n "num_gpu": 99\n}missing
10824Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_084156__30200.012.6380[82, 372]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_084156__302.json0.0missingmissingmissing
10825Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_101757__13400.056.26040[107, 436]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_101757__134.json0.0missing{\n "num_gpu": 99\n}missing
10826Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_101836__35400.038.85230[107, 297]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_101836__354.json0.0missing{\n "num_gpu": 99\n}missing
10827Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTfalsefalse520231214_084144__12400.015.3710[99, 446]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_084144__124.json0.0missingmissingmissing
10828Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_101612__39300.035.54353[110, 270]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_101612__393.json75.0missing{\n "num_gpu": 99\n}missing
10829Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTfalsefalse520231225_101701__56500.048.22580[110, 372]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_101701__565.json0.0missing{\n "num_gpu": 99\n}missing
10830Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_082353__82100.049.69650[110, 379]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_082353__821.json50.0missing{\n "num_gpu": 99\n}missing
10831Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_084128__10300.02.416730[128, 50]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_084128__103.json50.0missingmissingmissing
10832Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_101500__54800.049.68373[149, 377]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_101500__548.json75.0missing{\n "num_gpu": 99\n}missing
10833Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_101537__31700.036.18982[149, 269]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_101537__317.json66.6667missing{\n "num_gpu": 99\n}missing
10834Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_082304__45300.046.79012[149, 349]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_082304__453.json66.6667missing{\n "num_gpu": 99\n}missing
10835Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTfalsefalse520231214_084126__38200.018.89910[229, 492]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084126__382.json0.0missingmissingmissing
10836Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_101328__71900.046.48922[250, 157]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_101328__719.json66.6667missing{\n "num_gpu": 99\n}missing
10837Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_101410__99500.042.47732[250, 301]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_101410__995.json66.6667missing{\n "num_gpu": 99\n}missing
10838Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_082217__71600.051.83842[250, 205]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_082217__716.json66.6667missing{\n "num_gpu": 99\n}missing
10839Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruefalse520231214_084242__78900.017.57780[11, 476]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084242__789.json25.0missingmissingmissing
10840Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_102048__48800.059.0963[413, 397]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_102048__488.json75.0missing{\n "num_gpu": 99\n}missing
10841Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_102139__34400.051.57491[413, 339]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_102139__344.json58.3333missing{\n "num_gpu": 99\n}missing
10842Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_082602__80700.081.03863[413, 542]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_082602__807.json75.0missing{\n "num_gpu": 99\n}missing
10843Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231214_084224__86700.027.95230[399, 648]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_084224__867.json25.0missingmissingmissing
10844Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_101921__61200.045.29053[410, 290]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_101921__612.json75.0missing{\n "num_gpu": 99\n}missing
10845Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_101948__44600.027.29242[410, 149]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_101948__446.json66.6667missing{\n "num_gpu": 99\n}missing
10846Apple-MacBook-Pro-M1q_and_a_extractorphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231227_082441__22000.047.41563[410, 285]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_082441__220.json75.0missing{\n "num_gpu": 99\n}missing
10847Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_112824__23600.023.54050[104, 395]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_112824__236.json0.0missing{\n "num_gpu": 99\n}missing
10848Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse520231225_112850__73400.025.35220[104, 426]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_112850__734.json0.0missing{\n "num_gpu": 99\n}missing
10849Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_112736__62300.021.57360[107, 361]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_112736__623.json50.0missing{\n "num_gpu": 99\n}missing
10850Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_112801__27500.024.61480[107, 413]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_112801__275.json50.0missing{\n "num_gpu": 99\n}missing
10851Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_083310__44000.023.00730[107, 384]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_083310__440.json50.0missing{\n "num_gpu": 99\n}missing
10852Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_112653__98500.018.96840[148, 311]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_112653__985.json50.0missing{\n "num_gpu": 99\n}missing
10853Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231225_112714__71300.020.61830[148, 339]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_112714__713.json0.0missing{\n "num_gpu": 99\n}missing
10854Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_083247__86900.016.95880[148, 275]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_083247__869.json50.0missing{\n "num_gpu": 99\n}missing
10855Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_112613__74500.037.2510[249, 451]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_112613__745.json0.0missing{\n "num_gpu": 99\n}missing
10856Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231225_112634__99500.021.42880[249, 336]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_112634__995.json0.0missing{\n "num_gpu": 99\n}missing
10857Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_083230__49500.030.90540[249, 344]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_083230__495.json0.0missing{\n "num_gpu": 99\n}missing
10858Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520231225_112946__70000.015.32390[415, 207]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_112946__700.json25.0missing{\n "num_gpu": 99\n}missing
10859Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_113011__23800.025.6090[415, 379]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_113011__238.json50.0missing{\n "num_gpu": 99\n}missing
10860Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_083406__93300.019.36390[415, 274]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_083406__933.json50.0missing{\n "num_gpu": 99\n}missing
10861Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse520231225_112911__70600.021.39170[413, 309]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112911__706.json0.0missing{\n "num_gpu": 99\n}missing
10862Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_112930__78900.018.81961[413, 266]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_112930__789.json58.3333missing{\n "num_gpu": 99\n}missing
10863Apple-MacBook-Pro-M1q_and_a_extractorsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_083347__73500.036.90142[413, 561]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_083347__735.json66.6667missing{\n "num_gpu": 99\n}missing
10864Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrAsIs1SHOTfalsefalse520231214_083830__50400.011.52040[82, 339]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_083830__504.json0.0missingmissingmissing
10865Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrAsIs1SHOTfalsefalse520231225_100656__37300.03.906380[105, 216]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_100656__373.json0.0missing{\n "num_gpu": 99\n}missing
10866Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrAsIs1SHOTfalsefalse520231225_100700__10200.04.78650[105, 268]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_100700__102.json0.0missing{\n "num_gpu": 99\n}missing
10867Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTfalsefalse520231214_083818__89500.015.35150[99, 445]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_083818__895.json0.0missingmissingmissing
10868Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTtruetrue520231225_100647__39400.06.469860[108, 362]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_100647__394.json50.0missing{\n "num_gpu": 99\n}missing
10869Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTfalsefalse520231225_100652__86400.05.054510[108, 281]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_100652__864.json0.0missing{\n "num_gpu": 99\n}missing
10870Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrInJulia1SHOTfalsefalse520231227_081839__59100.06.984250[108, 387]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_081839__591.json0.0missing{\n "num_gpu": 99\n}missing
10871Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_083803__25200.09.008630[128, 253]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_083803__252.json50.0missingmissingmissing
10872Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_100631__79500.05.043340[145, 273]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_100631__795.json0.0missing{\n "num_gpu": 99\n}missing
10873Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_100640__64700.09.258190[145, 502]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_100640__647.json0.0missing{\n "num_gpu": 99\n}missing
10874Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231227_081832__86000.09.346760[145, 502]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_081832__860.json0.0missing{\n "num_gpu": 99\n}missing
10875Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTtruefalse520231214_083754__44000.019.83810[229, 517]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083754__440.json25.0missingmissingmissing
10876Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_100612__36500.010.35980[241, 384]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100612__365.json0.0missing{\n "num_gpu": 99\n}missing
10877Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_100626__99700.013.4850[241, 686]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_100626__997.json0.0missing{\n "num_gpu": 99\n}missing
10878Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231227_081823__21900.014.03330[241, 575]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081823__219.json0.0missing{\n "num_gpu": 99\n}missing
10879Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_083911__30000.020.7680[11, 557]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083911__300.json0.0missingmissingmissing
10880Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231225_100727__54400.05.885150[395, 256]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100727__544.json0.0missing{\n "num_gpu": 99\n}missing
10881Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTtruefalse520231225_100734__21700.07.215810[395, 325]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_100734__217.json25.0missing{\n "num_gpu": 99\n}missing
10882Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231227_081859__65500.08.803010[395, 399]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_081859__655.json0.0missing{\n "num_gpu": 99\n}missing
10883Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_083850__17400.020.07250[399, 450]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_083850__174.json50.0missingmissingmissing
10884Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_100708__69900.07.537420[393, 339]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_100708__699.json50.0missing{\n "num_gpu": 99\n}missing
10885Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_100721__17800.013.18450[393, 618]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_100721__178.json0.0missing{\n "num_gpu": 99\n}missing
10886Apple-MacBook-Pro-M1q_and_a_extractorstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_081850__69100.010.95370[393, 502]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_081850__691.json0.0missing{\n "num_gpu": 99\n}missing
10887Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestAsIs1SHOTfalsefalse520231214_082907__25000.020.77620[82, 599]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_082907__250.json0.0missingmissingmissing
10888Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestAsIs1SHOTfalsefalse520231225_094350__64300.013.74770[104, 440]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_094350__643.json0.0missing{\n "num_gpu": 99\n}missing
10889Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestAsIs1SHOTfalsefalse520231225_094405__65700.014.6040[104, 468]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_094405__657.json0.0missing{\n "num_gpu": 99\n}missing
10890Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTfalsefalse520231214_082846__84800.018.53780[99, 533]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_082846__848.json0.0missingmissingmissing
10891Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231225_094325__45600.011.32870[107, 360]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_094325__456.json50.0missing{\n "num_gpu": 99\n}missing
10892Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231225_094336__96700.010.78590[107, 344]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_094336__967.json50.0missing{\n "num_gpu": 99\n}missing
10893Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231227_022356__62300.09.94570[107, 313]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_022356__623.json50.0missing{\n "num_gpu": 99\n}missing
10894Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestInJulia1SHOTtruetrue520231227_080827__40300.013.0541[107, 413]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_080827__403.json58.3333missing{\n "num_gpu": 99\n}missing
10895Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_082827__70200.011.28280[128, 320]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_082827__702.json50.0missingmissingmissing
10896Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_094258__56700.012.01291[148, 378]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_094258__567.json58.3333missing{\n "num_gpu": 99\n}missing
10897Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_094314__76500.015.4592[148, 488]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_094314__765.json66.6667missing{\n "num_gpu": 99\n}missing
10898Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_022346__17200.011.03610[148, 342]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_022346__172.json50.0missing{\n "num_gpu": 99\n}missing
10899Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_080814__34500.011.62943[148, 360]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_080814__345.json75.0missing{\n "num_gpu": 99\n}missing
10900Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231214_082816__35300.016.03570[229, 414]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_082816__353.json0.0missingmissingmissing
10901Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_094233__87100.019.88310[249, 430]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094233__871.json50.0missing{\n "num_gpu": 99\n}missing
10902Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTtruefalse520231225_094246__99200.012.77860[249, 382]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094246__992.json25.0missing{\n "num_gpu": 99\n}missing
10903Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_022334__91300.014.95093[249, 284]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022334__913.json75.0missing{\n "num_gpu": 99\n}missing
10904Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse520231227_080802__11100.020.75850[249, 468]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_080802__111.json0.0missing{\n "num_gpu": 99\n}missing
10905Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruefalse520231214_083012__87100.031.15160[11, 806]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083012__871.json25.0missingmissingmissing
10906Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_094442__64400.09.607810[415, 251]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094442__644.json50.0missing{\n "num_gpu": 99\n}missing
10907Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231225_094458__75000.015.67980[415, 441]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_094458__750.json0.0missing{\n "num_gpu": 99\n}missing
10908Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_022422__31400.011.36911[415, 304]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022422__314.json58.3333missing{\n "num_gpu": 99\n}missing
10909Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_080902__14900.020.72691[415, 589]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_080902__149.json58.3333missing{\n "num_gpu": 99\n}missing
10910Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_082941__70700.033.69330[399, 784]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_082941__707.json50.0missingmissingmissing
10911Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_094416__37100.010.73783[413, 286]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_094416__371.json75.0missing{\n "num_gpu": 99\n}missing
10912Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_094433__31500.016.99083[413, 481]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_094433__315.json75.0missing{\n "num_gpu": 99\n}missing
10913Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_022410__20300.014.12993[413, 390]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_022410__203.json75.0missing{\n "num_gpu": 99\n}missing
10914Apple-MacBook-Pro-M1q_and_a_extractorstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_080841__55900.013.51460[413, 370]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_080841__559.json50.0missing{\n "num_gpu": 99\n}missing
10915Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatAsIs1SHOTfalsefalse520231214_083112__51500.022.95630[82, 657]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_083112__515.json0.0missingmissingmissing
10916Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatAsIs1SHOTfalsefalse520231225_095057__83700.056.13540[101, 416]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_095057__837.json0.0missing{\n "num_gpu": 99\n}missing
10917Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatAsIs1SHOTfalsefalse520231225_095211__47400.073.64440[101, 546]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_095211__474.json0.0missing{\n "num_gpu": 99\n}missing
10918Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruetrue520231214_083049__30800.010.03550[99, 290]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_083049__308.json50.0missingmissingmissing
10919Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTfalsefalse520231225_094908__19400.080.50290[104, 596]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_094908__194.json0.0missing{\n "num_gpu": 99\n}missing
10920Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruetrue520231225_095001__77400.052.84730[104, 390]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_095001__774.json50.0missing{\n "num_gpu": 99\n}missing
10921Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruefalse520231227_022747__43200.077.85540[104, 580]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_022747__432.json25.0missing{\n "num_gpu": 99\n}missing
10922Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatInJulia1SHOTtruetrue520231227_081214__19700.077.08270[104, 574]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_081214__197.json50.0missing{\n "num_gpu": 99\n}missing
10923Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_083039__37300.010.9311[128, 309]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_083039__373.json58.3333missingmissingmissing
10924Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_094701__30500.062.910[143, 451]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_094701__305.json50.0missing{\n "num_gpu": 99\n}missing
10925Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_094747__46500.045.62260[143, 329]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_094747__465.json50.0missing{\n "num_gpu": 99\n}missing
10926Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_022629__98300.063.97520[143, 470]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_022629__983.json50.0missing{\n "num_gpu": 99\n}missing
10927Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertAsk1SHOTfalsefalse520231227_081057__67700.053.42350[143, 390]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_081057__677.json0.0missing{\n "num_gpu": 99\n}missing
10928Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231214_083028__68900.015.6870[229, 405]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_083028__689.json0.0missingmissingmissing
10929Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_094543__37700.044.45440[244, 121]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094543__377.json50.0missing{\n "num_gpu": 99\n}missing
10930Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_094559__24400.015.51510[244, 81]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_094559__244.json50.0missing{\n "num_gpu": 99\n}missing
10931Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231227_022525__28700.063.53990[244, 278]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_022525__287.json0.0missing{\n "num_gpu": 99\n}missing
10932Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231227_081002__34800.060.40463[244, 254]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_081002__348.json75.0missing{\n "num_gpu": 99\n}missing
10933Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_083213__62900.020.41870[11, 548]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_083213__629.json50.0missingmissingmissing
10934Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231225_095549__90200.079.94590[417, 517]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_095549__902.json0.0missing{\n "num_gpu": 99\n}missing
10935Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231225_095721__46400.092.4120[417, 604]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_095721__464.json25.0missing{\n "num_gpu": 99\n}missing
10936Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapCoTTask1SHOTtruefalse520231227_022955__43900.064.38690[417, 414]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_022955__439.json25.0missing{\n "num_gpu": 99\n}missing
10937Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruefalse520231214_083152__84800.040.14860[399, 933]0.10.0-DEV31.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_083152__848.json25.0missingmissingmissing
10938Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_095320__94700.069.72063[415, 451]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_095320__947.json75.0missing{\n "num_gpu": 99\n}missing
10939Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_095429__34300.068.40940[415, 435]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_095429__343.json50.0missing{\n "num_gpu": 99\n}missing
10940Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231227_022851__90000.063.71920[415, 413]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_022851__900.json50.0missing{\n "num_gpu": 99\n}missing
10941Apple-MacBook-Pro-M1q_and_a_extractoryi:34b-chatJuliaRecapTask1SHOTtruetrue520231227_081310__44800.056.10290[415, 357]0.10.0-DEV31.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/q_and_a_extractor/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_081310__448.json50.0missing{\n "num_gpu": 99\n}missing
10942Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructAsIs1SHOTfalsefalse520231214_085014__67100.013.02160[57, 392]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_085014__671.json0.0missingmissingmissing
10943Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructAsIs1SHOTtruetrue520231225_085754__85950.014.68465[79, 268]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_085754__859.json100.0missing{\n "num_gpu": 99\n}missing
10944Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructAsIs1SHOTtruetrue520231225_085814__59250.020.03315[79, 369]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_085814__592.json100.0missing{\n "num_gpu": 99\n}missing
10945Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231214_085001__20710.09.779530[74, 291]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_085001__207.json55.0missingmissingmissing
10946Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231225_085720__16750.015.16715[82, 277]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_085720__167.json100.0missing{\n "num_gpu": 99\n}missing
10947Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231225_085739__61350.018.83545[82, 346]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_085739__613.json100.0missing{\n "num_gpu": 99\n}missing
10948Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructInJulia1SHOTtruetrue520231227_085640__77150.020.16055[82, 368]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_085640__771.json100.0missing{\n "num_gpu": 99\n}missing
10949Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231214_084951__80410.07.614350[103, 215]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_084951__804.json55.0missingmissingmissing
10950Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_085703__12400.04.536120[120, 68]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_085703__124.json0.0missing{\n "num_gpu": 99\n}missing
10951Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse520231225_085705__67200.02.652830[120, 31]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_085705__672.json0.0missing{\n "num_gpu": 99\n}missing
10952Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertAsk1SHOTtruetrue520231227_085619__74650.010.90735[120, 189]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_085619__746.json100.0missing{\n "num_gpu": 99\n}missing
10953Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231214_084943__31410.015.16080[201, 401]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084943__314.json55.0missingmissingmissing
10954Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231225_085648__27550.025.99085[219, 269]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085648__275.json100.0missing{\n "num_gpu": 99\n}missing
10955Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse520231225_085658__81300.09.720370[219, 151]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085658__813.json0.0missing{\n "num_gpu": 99\n}missing
10956Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue520231227_085608__90550.019.51265[219, 158]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085608__905.json100.0missing{\n "num_gpu": 99\n}missing
10957Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231214_085050__67910.011.74420[11, 326]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085050__679.json55.0missingmissingmissing
10958Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_085920__56650.025.67685[385, 407]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085920__566.json100.0missing{\n "num_gpu": 99\n}missing
10959Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231225_085932__52950.011.95655[385, 160]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085932__529.json100.0missing{\n "num_gpu": 99\n}missing
10960Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue520231227_085730__48410.038.08860[385, 616]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085730__484.json55.0missing{\n "num_gpu": 99\n}missing
10961Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruefalse520231214_085038__60500.024.02920[374, 564]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_085038__605.json25.0missingmissingmissing
10962Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_085836__93450.022.20615[382, 350]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_085836__934.json100.0missing{\n "num_gpu": 99\n}missing
10963Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231225_085855__13710.018.18230[382, 278]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_085855__137.json55.0missing{\n "num_gpu": 99\n}missing
10964Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-instructJuliaRecapTask1SHOTtruetrue520231227_085652__98450.012.46995[382, 172]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_085652__984.json100.0missing{\n "num_gpu": 99\n}missing
10965NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050428__45850.03.45955[0, 262]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050428__458.json100.0missing{\n "num_gpu": 99\n}missing
10966NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050435__65950.06.749465[0, 507]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050435__659.json100.0missing{\n "num_gpu": 99\n}missing
10967NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050438__52250.02.649435[0, 196]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050438__522.json100.0missing{\n "num_gpu": 99\n}missing
10968NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050441__82350.03.4365[0, 254]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050441__823.json100.0missing{\n "num_gpu": 99\n}missing
10969NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050447__10450.05.32225[0, 397]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050447__104.json100.0missing{\n "num_gpu": 99\n}missing
10970NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050400__53240.00.9370265[0, 71]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050400__532.json95.0missing{\n "num_gpu": 99\n}missing
10971NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050401__85450.00.5364135[0, 40]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050401__854.json100.0missing{\n "num_gpu": 99\n}missing
10972NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050402__35050.01.063515[0, 79]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050402__350.json100.0missing{\n "num_gpu": 99\n}missing
10973NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050405__64710.03.073830[0, 231]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050405__647.json55.0missing{\n "num_gpu": 99\n}missing
10974NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050406__24050.00.9953975[0, 75]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050406__240.json100.0missing{\n "num_gpu": 99\n}missing
10975NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050341__75450.03.375265[0, 251]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050341__754.json100.0missing{\n "num_gpu": 99\n}missing
10976NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050345__81050.04.089555[0, 303]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050345__810.json100.0missing{\n "num_gpu": 99\n}missing
10977NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_050349__27700.00.4658520[0, 35]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050349__277.json0.0missing{\n "num_gpu": 99\n}missing
10978NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050349__53150.03.16315[0, 237]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050349__531.json100.0missing{\n "num_gpu": 99\n}missing
10979NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_050350__40800.00.4685980[0, 35]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050350__408.json0.0missing{\n "num_gpu": 99\n}missing
10980NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050559__97750.07.907145[0, 558]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050559__977.json100.0missing{\n "num_gpu": 99\n}missing
10981NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050601__57150.02.437685[0, 175]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050601__571.json100.0missing{\n "num_gpu": 99\n}missing
10982NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050606__90350.05.114125[0, 367]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050606__903.json100.0missing{\n "num_gpu": 99\n}missing
10983NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050610__85450.04.15645[0, 298]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050610__854.json100.0missing{\n "num_gpu": 99\n}missing
10984NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_050611__56800.00.8528790[0, 61]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050611__568.json0.0missing{\n "num_gpu": 99\n}missing
10985NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050511__69950.03.19045[0, 234]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050511__699.json100.0missing{\n "num_gpu": 99\n}missing
10986NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050522__86610.011.21770[0, 805]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050522__866.json55.0missing{\n "num_gpu": 99\n}missing
10987NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050526__27250.03.868095[0, 283]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050526__272.json100.0missing{\n "num_gpu": 99\n}missing
10988NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050533__92210.06.851760[0, 497]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050533__922.json55.0missing{\n "num_gpu": 99\n}missing
10989NVIDIA-RTX-4090-4xtimezone_bumpercodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050537__89550.03.445245[0, 253]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050537__895.json100.0missing{\n "num_gpu": 99\n}missing
10990Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonAsIs1SHOTfalsefalse520231214_085138__33400.012.12260[57, 365]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_085138__334.json0.0missingmissingmissing
10991Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonAsIs1SHOTtruetrue520231225_090025__51250.03.459645[53, 57]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_090025__512.json100.0missing{\n "num_gpu": 99\n}missing
10992Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonAsIs1SHOTtruefalse520231225_090035__56700.09.677230[53, 178]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_090035__567.json25.0missing{\n "num_gpu": 99\n}missing
10993Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonInJulia1SHOTtruetrue520231214_085126__55710.013.66380[74, 397]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_085126__557.json55.0missingmissingmissing
10994Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonInJulia1SHOTtruefalse520231225_090019__18400.019.92420[56, 372]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_090019__184.json25.0missing{\n "num_gpu": 99\n}missing
10995Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonInJulia1SHOTfalsefalse520231225_090022__81700.03.084420[56, 50]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_090022__817.json0.0missing{\n "num_gpu": 99\n}missing
10996Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue520231214_085111__98710.06.762240[103, 190]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_085111__987.json55.0missingmissingmissing
10997Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_085954__12900.06.727090[57, 121]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_085954__129.json0.0missing{\n "num_gpu": 99\n}missing
10998Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertAsk1SHOTfalsefalse520231225_085959__40600.04.737380[57, 82]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_085959__406.json0.0missing{\n "num_gpu": 99\n}missing
10999Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue520231214_085104__13810.014.46550[201, 382]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085104__138.json55.0missingmissingmissing
11000Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_085945__31800.012.34630[94, 30]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085945__318.json0.0missing{\n "num_gpu": 99\n}missing
11001Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse520231225_085947__76700.02.319380[94, 29]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_085947__767.json0.0missing{\n "num_gpu": 99\n}missing
11002Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapCoTTask1SHOTtruetrue520231214_085232__43110.025.98120[11, 686]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085232__431.json55.0missingmissingmissing
11003Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse520231225_090047__47400.01.216170[74, 8]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090047__474.json0.0missing{\n "num_gpu": 99\n}missing
11004Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231214_085206__85010.027.40670[374, 641]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_085206__850.json55.0missingmissingmissing
11005Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapTask1SHOTtruetrue520231225_090038__59910.03.465790[71, 52]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_090038__599.json55.0missing{\n "num_gpu": 99\n}missing
11006Apple-MacBook-Pro-M1timezone_bumpercodellama:13b-pythonJuliaRecapTask1SHOTtruefalse520231225_090046__21800.07.288740[71, 126]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_090046__218.json25.0missing{\n "num_gpu": 99\n}missing
11007NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_051053__35550.06.543955[0, 234]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_051053__355.json100.0missing{\n "num_gpu": 99\n}missing
11008NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_051100__26150.07.347085[0, 262]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_051100__261.json100.0missing{\n "num_gpu": 99\n}missing
11009NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_051111__85030.010.53214[0, 375]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_051111__850.json85.0missing{\n "num_gpu": 99\n}missing
11010NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_051117__14250.06.375[0, 230]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_051117__142.json100.0missing{\n "num_gpu": 99\n}missing
11011NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_051126__56350.08.727225[0, 314]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_051126__563.json100.0missing{\n "num_gpu": 99\n}missing
11012NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050937__81950.02.687625[0, 97]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050937__819.json100.0missing{\n "num_gpu": 99\n}missing
11013NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050942__88350.05.107565[0, 184]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050942__883.json100.0missing{\n "num_gpu": 99\n}missing
11014NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050943__44450.01.303625[0, 47]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050943__444.json100.0missing{\n "num_gpu": 99\n}missing
11015NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050946__61250.02.936395[0, 106]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050946__612.json100.0missing{\n "num_gpu": 99\n}missing
11016NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050956__71350.010.31915[0, 371]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050956__713.json100.0missing{\n "num_gpu": 99\n}missing
11017NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050847__69350.06.384765[0, 226]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050847__693.json100.0missing{\n "num_gpu": 99\n}missing
11018NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050853__26350.06.379155[0, 227]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050853__263.json100.0missing{\n "num_gpu": 99\n}missing
11019NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050903__61550.09.24065[0, 328]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050903__615.json100.0missing{\n "num_gpu": 99\n}missing
11020NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050914__59050.010.88145[0, 385]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050914__590.json100.0missing{\n "num_gpu": 99\n}missing
11021NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_050916__88000.01.860960[0, 66]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050916__880.json0.0missing{\n "num_gpu": 99\n}missing
11022NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_051314__75100.01.973890[0, 69]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_051314__751.json0.0missing{\n "num_gpu": 99\n}missing
11023NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_051316__87100.01.879550[0, 67]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_051316__871.json0.0missing{\n "num_gpu": 99\n}missing
11024NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_051318__36300.01.683870[0, 60]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_051318__363.json0.0missing{\n "num_gpu": 99\n}missing
11025NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_051325__98450.07.762455[0, 275]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_051325__984.json100.0missing{\n "num_gpu": 99\n}missing
11026NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_051332__10700.06.396320[0, 227]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_051332__107.json0.0missing{\n "num_gpu": 99\n}missing
11027NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_051138__80900.00.1427930[0, 5]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_051138__809.json0.0missing{\n "num_gpu": 99\n}missing
11028NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_051138__86300.01.677160[0, 60]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_051138__863.json0.0missing{\n "num_gpu": 99\n}missing
11029NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_051138__94200.00.1426880[0, 5]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_051138__942.json0.0missing{\n "num_gpu": 99\n}missing
11030NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_051139__10500.00.1428290[0, 5]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_051139__105.json0.0missing{\n "num_gpu": 99\n}missing
11031NVIDIA-RTX-4090-4xtimezone_bumpercodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_051141__44200.02.207450[0, 79]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_051141__442.json0.0missing{\n "num_gpu": 99\n}missing
11032NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_045952__12050.06.597375[0, 161]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_045952__120.json100.0missing{\n "num_gpu": 99\n}missing
11033NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_045954__82100.02.492510[0, 61]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_045954__821.json0.0missing{\n "num_gpu": 99\n}missing
11034NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_050000__27900.06.170680[0, 150]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_050000__279.json0.0missing{\n "num_gpu": 99\n}missing
11035NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse520240201_050006__46400.00.5691220[0, 14]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_050006__464.json0.0missing{\n "num_gpu": 99\n}missing
11036NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KInJulia1SHOTtruetrue520240201_050006__97810.05.183640[0, 128]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_050006__978.json55.0missing{\n "num_gpu": 99\n}missing
11037NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse520240201_045732__35600.07.589110[0, 187]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_045732__356.json0.0missing{\n "num_gpu": 99\n}missing
11038NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_045752__10010.019.6145[0, 478]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_045752__100.json80.0missing{\n "num_gpu": 99\n}missing
11039NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_045802__92010.010.52280[0, 258]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_045802__920.json55.0missing{\n "num_gpu": 99\n}missing
11040NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_045813__88740.011.08865[0, 272]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_045813__887.json95.0missing{\n "num_gpu": 99\n}missing
11041NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue520240201_045825__96410.011.77050[0, 289]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_045825__964.json55.0missing{\n "num_gpu": 99\n}missing
11042NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_045543__91610.06.848690[0, 167]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_045543__916.json55.0missing{\n "num_gpu": 99\n}missing
11043NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_045553__75300.09.685120[0, 237]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_045553__753.json0.0missing{\n "num_gpu": 99\n}missing
11044NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse520240201_045555__59200.02.451560[0, 60]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_045555__592.json0.0missing{\n "num_gpu": 99\n}missing
11045NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_045610__61950.014.53225[0, 354]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_045610__619.json100.0missing{\n "num_gpu": 99\n}missing
11046NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruetrue520240201_045624__24650.013.52285[0, 326]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_045624__246.json100.0missing{\n "num_gpu": 99\n}missing
11047NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_050237__62300.05.383470[0, 131]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050237__623.json0.0missing{\n "num_gpu": 99\n}missing
11048NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_050247__92300.09.569840[0, 232]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050247__923.json0.0missing{\n "num_gpu": 99\n}missing
11049NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_050250__52450.02.952655[0, 72]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050250__524.json100.0missing{\n "num_gpu": 99\n}missing
11050NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse520240201_050309__62800.018.80560[0, 454]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050309__628.json0.0missing{\n "num_gpu": 99\n}missing
11051NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue520240201_050318__61940.09.659535[0, 234]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050318__619.json95.0missing{\n "num_gpu": 99\n}missing
11052NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_050104__57500.04.523440[0, 110]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_050104__575.json0.0missing{\n "num_gpu": 99\n}missing
11053NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_050126__46010.021.72415[0, 523]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_050126__460.json80.0missing{\n "num_gpu": 99\n}missing
11054NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_050131__81600.05.103060[0, 124]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_050131__816.json0.0missing{\n "num_gpu": 99\n}missing
11055NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue520240201_050141__41750.09.636465[0, 233]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_050141__417.json100.0missing{\n "num_gpu": 99\n}missing
11056NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse520240201_050150__62600.09.667420[0, 234]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_050150__626.json0.0missing{\n "num_gpu": 99\n}missing
11057NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_044902__45000.011.29840[0, 211]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_044902__450.json0.0missing{\n "num_gpu": 99\n}missing
11058NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_044905__51000.03.256450[0, 61]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_044905__510.json0.0missing{\n "num_gpu": 99\n}missing
11059NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse520240201_044912__71000.06.722560[0, 126]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_044912__710.json0.0missing{\n "num_gpu": 99\n}missing
11060NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_044919__75050.07.579695[0, 142]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_044919__750.json100.0missing{\n "num_gpu": 99\n}missing
11061NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_044932__74450.012.70535[0, 234]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_044932__744.json100.0missing{\n "num_gpu": 99\n}missing
11062NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_044617__62600.023.17880[0, 431]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_044617__626.json0.0missing{\n "num_gpu": 99\n}missing
11063NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_044641__83910.023.75410[0, 442]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_044641__839.json55.0missing{\n "num_gpu": 99\n}missing
11064NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_044651__87750.09.893525[0, 185]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_044651__877.json100.0missing{\n "num_gpu": 99\n}missing
11065NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_044706__37150.014.45835[0, 270]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_044706__371.json100.0missing{\n "num_gpu": 99\n}missing
11066NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_044732__60650.026.55615[0, 494]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_044732__606.json100.0missing{\n "num_gpu": 99\n}missing
11067NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_044401__14950.010.97675[0, 205]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_044401__149.json100.0missing{\n "num_gpu": 99\n}missing
11068NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_044419__98750.017.55645[0, 327]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_044419__987.json100.0missing{\n "num_gpu": 99\n}missing
11069NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_044429__34400.09.804220[0, 183]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_044429__344.json0.0missing{\n "num_gpu": 99\n}missing
11070NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_044440__53150.011.72855[0, 219]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_044440__531.json100.0missing{\n "num_gpu": 99\n}missing
11071NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520240201_044455__42500.014.64670[0, 273]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_044455__425.json0.0missing{\n "num_gpu": 99\n}missing
11072NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_045312__77300.012.14250[0, 224]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_045312__773.json0.0missing{\n "num_gpu": 99\n}missing
11073NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_045320__22700.07.327760[0, 136]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_045320__227.json0.0missing{\n "num_gpu": 99\n}missing
11074NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520240201_045346__41800.025.92190[0, 476]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_045346__418.json0.0missing{\n "num_gpu": 99\n}missing
11075NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse520240201_045411__85000.025.56340[0, 468]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_045411__850.json25.0missing{\n "num_gpu": 99\n}missing
11076NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_045427__73250.015.54645[0, 286]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_045427__732.json100.0missing{\n "num_gpu": 99\n}missing
11077NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_045113__41750.017.53815[0, 321]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_045113__417.json100.0missing{\n "num_gpu": 99\n}missing
11078NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_045121__56450.08.204695[0, 151]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_045121__564.json100.0missing{\n "num_gpu": 99\n}missing
11079NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_045134__87200.012.80240[0, 237]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_045134__872.json0.0missing{\n "num_gpu": 99\n}missing
11080NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_045142__39150.08.561735[0, 159]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_045142__391.json100.0missing{\n "num_gpu": 99\n}missing
11081NVIDIA-RTX-4090-4xtimezone_bumpercodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_045152__87610.09.804040[0, 182]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_045152__876.json55.0missing{\n "num_gpu": 99\n}missing
11082NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050646__83450.01.859345[0, 225]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050646__834.json100.0missing{\n "num_gpu": 99\n}missing
11083NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050648__17650.02.013795[0, 239]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050648__176.json100.0missing{\n "num_gpu": 99\n}missing
11084NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050650__66750.01.27615[0, 148]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050650__667.json100.0missing{\n "num_gpu": 99\n}missing
11085NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050651__32810.01.94695[0, 223]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050651__328.json80.0missing{\n "num_gpu": 99\n}missing
11086NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue520240201_050653__63550.01.362835[0, 158]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_050653__635.json100.0missing{\n "num_gpu": 99\n}missing
11087NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_050637__21900.00.4717180[0, 55]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050637__219.json0.0missing{\n "num_gpu": 99\n}missing
11088NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050638__32050.00.8795735[0, 103]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050638__320.json100.0missing{\n "num_gpu": 99\n}missing
11089NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_050638__71900.00.3008630[0, 35]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050638__719.json0.0missing{\n "num_gpu": 99\n}missing
11090NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520240201_050639__53250.00.8807435[0, 103]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050639__532.json100.0missing{\n "num_gpu": 99\n}missing
11091NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520240201_050640__80700.00.3027870[0, 35]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_050640__807.json0.0missing{\n "num_gpu": 99\n}missing
11092NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050625__14550.00.8145695[0, 98]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050625__145.json100.0missing{\n "num_gpu": 99\n}missing
11093NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050626__87550.01.626925[0, 188]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050626__875.json100.0missing{\n "num_gpu": 99\n}missing
11094NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050630__29250.03.252785[0, 374]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050630__292.json100.0missing{\n "num_gpu": 99\n}missing
11095NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050631__86950.01.095225[0, 127]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050631__869.json100.0missing{\n "num_gpu": 99\n}missing
11096NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520240201_050632__49750.01.283325[0, 149]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_050632__497.json100.0missing{\n "num_gpu": 99\n}missing
11097NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050730__64150.02.554145[0, 299]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050730__641.json100.0missing{\n "num_gpu": 99\n}missing
11098NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050735__56950.04.731825[0, 549]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050735__569.json100.0missing{\n "num_gpu": 99\n}missing
11099NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050739__36050.04.327815[0, 503]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050739__360.json100.0missing{\n "num_gpu": 99\n}missing
11100NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050743__74120.03.412491[0, 397]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050743__741.json65.0missing{\n "num_gpu": 99\n}missing
11101NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520240201_050749__29810.06.005515[0, 691]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_050749__298.json80.0missing{\n "num_gpu": 99\n}missing
11102NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050709__89650.03.23395[0, 354]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050709__896.json100.0missing{\n "num_gpu": 99\n}missing
11103NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050712__98150.02.543465[0, 277]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050712__981.json100.0missing{\n "num_gpu": 99\n}missing
11104NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_050715__18400.00.2921890[0, 32]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050715__184.json0.0missing{\n "num_gpu": 99\n}missing
11105NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse520240201_050715__69800.00.2918330[0, 32]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050715__698.json0.0missing{\n "num_gpu": 99\n}missing
11106NVIDIA-RTX-4090-4xtimezone_bumpercodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520240201_050715__91450.02.730345[0, 301]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_050715__914.json100.0missing{\n "num_gpu": 99\n}missing
11107Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue520231225_092118__92250.051.04445[70, 309]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_092118__922.json100.0missing{\n "num_gpu": 99\n}missing
11108Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue520231225_092156__78050.037.71535[70, 225]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_092156__780.json100.0missing{\n "num_gpu": 99\n}missing
11109Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_091943__50850.039.48115[73, 237]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_091943__508.json100.0missing{\n "num_gpu": 99\n}missing
11110Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_092027__56550.043.67325[73, 263]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_092027__565.json100.0missing{\n "num_gpu": 99\n}missing
11111Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_090521__83850.026.88415[73, 157]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_090521__838.json100.0missing{\n "num_gpu": 99\n}missing
11112Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_091833__85050.038.6515[114, 226]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_091833__850.json100.0missing{\n "num_gpu": 99\n}missing
11113Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_091903__12050.030.03925[114, 172]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_091903__120.json100.0missing{\n "num_gpu": 99\n}missing
11114Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_090454__28950.031.25485[114, 179]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090454__289.json100.0missing{\n "num_gpu": 99\n}missing
11115Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_091618__59750.065.71385[212, 210]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_091618__597.json100.0missing{\n "num_gpu": 99\n}missing
11116Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_091754__22750.095.93675[212, 557]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_091754__227.json100.0missing{\n "num_gpu": 99\n}missing
11117Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_090422__83850.088.69635[212, 367]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090422__838.json100.0missing{\n "num_gpu": 99\n}missing
11118Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092419__26250.044.46275[402, 213]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092419__262.json100.0missing{\n "num_gpu": 99\n}missing
11119Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092459__26650.040.22675[402, 187]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092459__266.json100.0missing{\n "num_gpu": 99\n}missing
11120Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_090707__47450.073.06785[402, 384]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090707__474.json100.0missing{\n "num_gpu": 99\n}missing
11121Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092248__48150.051.9535[400, 258]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092248__481.json100.0missing{\n "num_gpu": 99\n}missing
11122Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092334__10150.046.12055[400, 222]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092334__101.json100.0missing{\n "num_gpu": 99\n}missing
11123Apple-MacBook-Pro-M1timezone_bumperdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_090554__21150.033.26635[400, 144]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_090554__211.json100.0missing{\n "num_gpu": 99\n}missing
11124Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_091356__77000.09.764890[77, 375]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_091356__770.json0.0missing{\n "num_gpu": 99\n}missing
11125Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_131925__42600.010.08010[77, 388]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_131925__426.json0.0missing{\n "num_gpu": 99\n}missing
11126Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_131934__59000.08.743970[77, 337]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_131934__590.json0.0missing{\n "num_gpu": 99\n}missing
11127Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse520231227_131942__17300.07.393120[77, 285]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_131942__173.json0.0missing{\n "num_gpu": 99\n}missing
11128Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_091346__72310.07.177030[114, 271]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_091346__723.json55.0missing{\n "num_gpu": 99\n}missing
11129Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_131858__38000.02.941650[114, 105]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_131858__380.json0.0missing{\n "num_gpu": 99\n}missing
11130Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruetrue520231227_131907__48910.09.207550[114, 349]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_131907__489.json55.0missing{\n "num_gpu": 99\n}missing
11131Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_131915__84700.08.00690[114, 303]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_131915__847.json0.0missing{\n "num_gpu": 99\n}missing
11132Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_091339__42600.08.715120[203, 185]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091339__426.json0.0missing{\n "num_gpu": 99\n}missing
11133Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_131841__11900.011.90220[203, 299]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_131841__119.json0.0missing{\n "num_gpu": 99\n}missing
11134Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_131846__50800.04.32350[203, 146]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_131846__508.json0.0missing{\n "num_gpu": 99\n}missing
11135Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_131855__54500.09.210930[203, 332]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_131855__545.json0.0missing{\n "num_gpu": 99\n}missing
11136Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_091415__20500.08.619340[366, 278]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091415__205.json0.0missing{\n "num_gpu": 99\n}missing
11137Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_132030__95100.011.23390[366, 373]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_132030__951.json0.0missing{\n "num_gpu": 99\n}missing
11138Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_132048__14700.017.2710[366, 584]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_132048__147.json0.0missing{\n "num_gpu": 99\n}missing
11139Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_132056__62200.08.03010[366, 257]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_132056__622.json0.0missing{\n "num_gpu": 99\n}missing
11140Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_091407__36700.010.23970[363, 337]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_091407__367.json0.0missing{\n "num_gpu": 99\n}missing
11141Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue520231227_131950__41310.08.732540[363, 283]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_131950__413.json55.0missing{\n "num_gpu": 99\n}missing
11142Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_132001__27200.010.55280[363, 349]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_132001__272.json0.0missing{\n "num_gpu": 99\n}missing
11143Apple-MacBook-Pro-M1timezone_bumperdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse520231227_132019__45500.018.1970[363, 616]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_132019__455.json0.0missing{\n "num_gpu": 99\n}missing
11144Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112338__24110.02.944030[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112338__241.json55.0missingmissingmissing
11145Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestInJulia1SHOTtruefalse520240217_112340__18100.02.7140[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112340__181.json25.0missingmissingmissing
11146Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112343__22010.02.543640[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112343__220.json55.0missingmissingmissing
11147Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112348__57310.04.412160[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112348__573.json55.0missingmissingmissing
11148Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestInJulia1SHOTtruetrue520240217_112350__76310.02.732840[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_112350__763.json55.0missingmissingmissing
11149Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_112308__42410.02.102960[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112308__424.json55.0missingmissingmissing
11150Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_112313__63710.05.072650[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112313__637.json55.0missingmissingmissing
11151Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_112315__28710.01.729730[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112315__287.json55.0missingmissingmissing
11152Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_112319__73210.03.457580[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112319__732.json55.0missingmissingmissing
11153Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue520240217_112321__84310.02.066580[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112321__843.json55.0missingmissingmissing
11154Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue520240217_112235__79610.02.876740[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112235__796.json55.0missingmissingmissing
11155Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_112238__92800.02.697090[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112238__928.json25.0missingmissingmissing
11156Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_112240__74400.02.173120[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112240__744.json25.0missingmissingmissing
11157Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_112248__77400.07.161050[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112248__774.json25.0missingmissingmissing
11158Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse520240217_112250__94200.02.212690[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112250__942.json25.0missingmissingmissing
11159Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse520240217_112505__83900.03.439580[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112505__839.json25.0missingmissingmissing
11160Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_112513__37910.07.634140[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112513__379.json55.0missingmissingmissing
11161Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse520240217_112516__72500.03.001390[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112516__725.json0.0missingmissingmissing
11162Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_112521__59910.04.839720[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112521__599.json55.0missingmissingmissing
11163Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue520240217_112525__11010.03.630290[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112525__110.json55.0missingmissingmissing
11164Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_112408__44710.02.483890[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112408__447.json55.0missingmissingmissing
11165Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_112413__18600.04.393590[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112413__186.json25.0missingmissingmissing
11166Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_112417__94610.04.266250[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112417__946.json55.0missingmissingmissing
11167Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue520240217_112421__99010.03.747030[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112421__990.json55.0missingmissingmissing
11168Apple-MacBook-Pro-M1timezone_bumpergemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse520240217_112424__39700.03.065390[0, 0]0.13.0-DEV51.0{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112424__397.json25.0missingmissingmissing
11169Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240224_003715__92510.029.61710[0, 327]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_003715__925.json55.0missingmissingmissing
11170Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240224_003747__40410.031.46490[0, 347]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_003747__404.json55.0missingmissingmissing
11171Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240224_003752__69310.05.404570[0, 60]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_003752__693.json55.0missingmissingmissing
11172Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240224_003758__45510.05.421130[0, 60]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_003758__455.json55.0missingmissingmissing
11173Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KInJulia1SHOTtruetrue520240224_003834__13410.036.85490[0, 405]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_003834__134.json55.0missingmissingmissing
11174Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240224_003433__33600.03.706720[0, 55]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_003433__336.json0.0missingmissingmissing
11175Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240224_003437__53400.03.892320[0, 61]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_003437__534.json0.0missingmissingmissing
11176Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240224_003440__44200.03.882880[0, 61]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_003440__442.json0.0missingmissingmissing
11177Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240224_003444__50700.03.662740[0, 58]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_003444__507.json0.0missingmissingmissing
11178Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse520240224_003448__75300.03.944810[0, 56]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_003448__753.json0.0missingmissingmissing
11179Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_003238__99400.027.80060[0, 424]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_003238__994.json25.0missingmissingmissing
11180Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_003302__86000.023.56360[0, 360]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_003302__860.json25.0missingmissingmissing
11181Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_003326__61800.024.12260[0, 366]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_003326__618.json25.0missingmissingmissing
11182Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruefalse520240224_003349__37700.023.1960[0, 356]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_003349__377.json25.0missingmissingmissing
11183Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTtruetrue520240224_003410__25710.020.67620[0, 316]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_003410__257.json55.0missingmissingmissing
11184Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_004707__91410.028.01030[0, 297]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_004707__914.json55.0missingmissingmissing
11185Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_004748__41410.041.49480[0, 439]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_004748__414.json55.0missingmissingmissing
11186Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_004825__26310.037.11980[0, 393]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_004825__263.json55.0missingmissingmissing
11187Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_004846__71310.020.35510[0, 216]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_004846__713.json55.0missingmissingmissing
11188Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruetrue520240224_004918__60310.032.31810[0, 343]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_004918__603.json55.0missingmissingmissing
11189Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_004139__38910.037.55050[0, 397]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_004139__389.json55.0missingmissingmissing
11190Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_004216__31210.036.87120[0, 388]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_004216__312.json55.0missingmissingmissing
11191Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_004257__74110.041.13550[0, 433]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_004257__741.json55.0missingmissingmissing
11192Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_004319__70310.022.3140[0, 236]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_004319__703.json55.0missingmissingmissing
11193Apple-MacBook-Pro-M1timezone_bumpergemma:7b-instruct-q6_KJuliaRecapTask1SHOTtruetrue520240224_004349__56310.029.65450[0, 313]0.13.0-DEV51.0{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_004349__563.json55.0missingmissingmissing
11194Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboAsIs1SHOTtruetrue520231213_205614__80750.00060357.487485[64, 381]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_205614__807.json100.0missingmissingmissing
11195Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboAsIs1SHOTtruetrue520231225_230816__56050.00029752.373325[64, 177]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_230816__560.json100.0missingmissingmissing
11196Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboAsIs1SHOTtruetrue520231225_230819__24850.0003833.181665[64, 234]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_230819__248.json100.0missingmissingmissing
11197Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo--optimAsIs1SHOTtruetrue520231215_201737__45150.04.52975[64, 177]0.10.0-DEV51.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_201737__451.json100.00.5missing0.5
11198Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboInJulia1SHOTtruetrue520231213_205607__88450.00042956.123475[67, 264]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_205607__884.json100.0missingmissingmissing
11199Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboInJulia1SHOTtruetrue520231225_230808__93550.00069656.443975[67, 442]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_230808__935.json100.0missingmissingmissing
11200Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboInJulia1SHOTtruetrue520231225_230813__31550.0005725.558915[67, 359]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_230813__315.json100.0missingmissingmissing
11201Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboInJulia1SHOTtruetrue520231227_205657__30650.00053154.972685[67, 332]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_205657__306.json100.0missingmissingmissing
11202Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboInJulia1SHOTtruetrue520231227_205701__43650.00051654.534775[67, 322]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_205701__436.json100.0missingmissingmissing
11203Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo--optimInJulia1SHOTtruetrue520231215_201732__87150.07.153725[67, 344]0.10.0-DEV51.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_201732__871.json100.00.5missing0.5
11204Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertAsk1SHOTfalsefalse520231213_205601__29500.0001351.759580[102, 56]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_205601__295.json0.0missingmissingmissing
11205Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_230758__62350.00034353.37065[102, 195]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_230758__623.json100.0missingmissingmissing
11206Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231225_230801__37450.00029552.6755[102, 163]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_230801__374.json100.0missingmissingmissing
11207Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_205650__19550.0002552.396855[102, 136]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_205650__195.json100.0missingmissingmissing
11208Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertAsk1SHOTtruetrue520231227_205652__14650.00014551.509785[102, 63]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_205652__146.json100.0missingmissingmissing
11209Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue520231215_201725__94650.04.198755[102, 146]0.10.0-DEV51.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_201725__946.json100.00.5missing0.5
11210Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231213_205559__55600.00028553.184490[181, 130]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_205559__556.json0.0missingmissingmissing
11211Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_230754__81200.00021951.458850[181, 86]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230754__812.json0.0missingmissingmissing
11212Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231225_230755__56500.00017451.271110[181, 56]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230755__565.json0.0missingmissingmissing
11213Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue520231227_205646__48350.00013551.170745[181, 30]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205646__483.json100.0missingmissingmissing
11214Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse520231227_205648__30700.00019551.608910[181, 70]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205648__307.json0.0missingmissingmissing
11215Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTtruetrue520231215_201721__25450.04.256545[181, 200]0.10.0-DEV51.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201721__254.json100.00.5missing0.5
11216Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231213_205620__32500.0003173.305890[325, 103]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_205620__325.json0.0missingmissingmissing
11217Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231225_230825__17750.00049253.207145[325, 220]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230825__177.json100.0missingmissingmissing
11218Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231225_230828__33200.00025552.735410[325, 62]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230828__332.json0.0missingmissingmissing
11219Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue520231227_205710__38150.0007165.851775[325, 369]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205710__381.json100.0missingmissingmissing
11220Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse520231227_205712__50900.000261.51330[325, 65]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205712__509.json0.0missingmissingmissing
11221Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue520231215_201744__52050.05.40695[325, 244]0.10.0-DEV51.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201744__520.json100.00.5missing0.5
11222Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231213_205617__15800.000272.311980[324, 72]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_205617__158.json0.0missingmissingmissing
11223Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_230820__88500.00021451.040220[324, 35]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_230820__885.json0.0missingmissingmissing
11224Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231225_230822__47400.000271.409720[324, 72]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_230822__474.json0.0missingmissingmissing
11225Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_205703__70200.0003481.978560[324, 124]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_205703__702.json0.0missingmissingmissing
11226Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turboJuliaRecapTask1SHOTfalsefalse520231227_205704__40100.0002461.130020[324, 56]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_205704__401.json0.0missingmissingmissing
11227Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo--optimJuliaRecapTask1SHOTfalsefalse520231215_201739__49000.01.613950[324, 70]0.10.0-DEV51.0{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_201739__490.json0.00.5missing0.5
11228Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200713__49650.000321.39455[67, 191]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200713__496.json100.0missingmissingmissing
11229Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200714__91550.0002151.067765[67, 121]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200714__915.json100.0missingmissingmissing
11230Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200715__38910.0002421.081470[67, 139]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200715__389.json55.0missingmissingmissing
11231Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200717__32650.00023151.295965[67, 132]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200717__326.json100.0missingmissingmissing
11232Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125InJulia1SHOTtruetrue520240201_200718__76550.0002541.357355[67, 147]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200718__765.json100.0missingmissingmissing
11233Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200708__43650.0001560.8025065[102, 70]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200708__436.json100.0missingmissingmissing
11234Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200709__59550.00015750.9759495[102, 71]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200709__595.json100.0missingmissingmissing
11235Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200710__58150.00014850.8575415[102, 65]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200710__581.json100.0missingmissingmissing
11236Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue520240201_200711__16750.000150.8801115[102, 66]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200711__167.json100.0missingmissingmissing
11237Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruefalse520240201_200712__79700.0002040.8570710[102, 102]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200712__797.json25.0missingmissingmissing
11238Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200704__40750.00017750.8527035[181, 58]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200704__407.json100.0missingmissingmissing
11239Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200704__76950.00020150.6879195[181, 74]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200704__769.json100.0missingmissingmissing
11240Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200705__29350.0002030.9678525[181, 75]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200705__293.json100.0missingmissingmissing
11241Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200706__11250.00020150.6845185[181, 74]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200706__112.json100.0missingmissingmissing
11242Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue520240201_200707__60950.0002090.940355[181, 79]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200707__609.json100.0missingmissingmissing
11243Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200724__57800.00032151.148250[325, 106]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200724__578.json0.0missingmissingmissing
11244Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTtruefalse520240201_200727__16000.00070552.467110[325, 362]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200727__160.json25.0missingmissingmissing
11245Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200728__92300.00032451.017880[325, 108]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200728__923.json0.0missingmissingmissing
11246Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200730__49600.00037252.189710[325, 140]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200730__496.json0.0missingmissingmissing
11247Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse520240201_200731__56200.0002991.023790[325, 91]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200731__562.json0.0missingmissingmissing
11248Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200720__12550.00049351.902015[324, 221]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200720__125.json100.0missingmissingmissing
11249Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200721__14220.00025350.8409051[324, 61]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200721__142.json65.0missingmissingmissing
11250Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200722__46050.0002730.694715[324, 74]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200722__460.json100.0missingmissingmissing
11251Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200723__21550.0002640.6650115[324, 68]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200723__215.json100.0missingmissingmissing
11252Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue520240201_200723__56150.000210.4511655[324, 32]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200723__561.json100.0missingmissingmissing
11253Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231213_205631__95950.0005885.448665[64, 262]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_205631__959.json100.0missingmissingmissing
11254Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_230837__25950.00041.90955[64, 168]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_230837__259.json100.0missingmissingmissing
11255Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106AsIs1SHOTtruetrue520231225_230840__95950.0004262.131975[64, 181]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_230840__959.json100.0missingmissingmissing
11256Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106--optimAsIs1SHOTtruetrue520231215_201754__29050.02.638935[64, 167]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_201754__290.json100.00.9missing0.1
11257Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231213_205626__59350.0003612.42185[67, 147]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_205626__593.json100.0missingmissingmissing
11258Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_230834__16550.0003751.781435[67, 154]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_230834__165.json100.0missingmissingmissing
11259Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231225_230835__72950.0003151.445575[67, 124]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_230835__729.json100.0missingmissingmissing
11260Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_205718__29050.0003252.355745[67, 129]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_205718__290.json100.0missingmissingmissing
11261Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106InJulia1SHOTtruetrue520231227_205720__12650.0003111.844635[67, 122]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_205720__126.json100.0missingmissingmissing
11262Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue520231215_201751__96550.04.220675[67, 165]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_201751__965.json100.00.9missing0.1
11263Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231213_205623__46950.000161.267845[102, 29]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_205623__469.json100.0missingmissingmissing
11264Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_230831__62150.0002221.046335[102, 60]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_230831__621.json100.0missingmissingmissing
11265Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231225_230832__38650.0001661.159465[102, 32]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_230832__386.json100.0missingmissingmissing
11266Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_205715__77650.0002241.132315[102, 61]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_205715__776.json100.0missingmissingmissing
11267Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue520231227_205716__17450.000160.7795335[102, 29]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_205716__174.json100.0missingmissingmissing
11268Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue520231215_201747__72550.00.9673595[102, 29]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_201747__725.json100.00.9missing0.1
11269Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231213_205622__37250.0002391.633465[181, 29]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_205622__372.json100.0missingmissingmissing
11270Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_230829__30250.0003531.089165[181, 86]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230829__302.json100.0missingmissingmissing
11271Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231225_230830__10950.0002390.7065185[181, 29]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230830__109.json100.0missingmissingmissing
11272Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_205713__39850.0002390.7375215[181, 29]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205713__398.json100.0missingmissingmissing
11273Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue520231227_205714__18250.0002590.9846865[181, 39]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_205714__182.json100.0missingmissingmissing
11274Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue520231215_201746__79950.01.81095[181, 29]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201746__799.json100.00.9missing0.1
11275Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTtruetrue520231213_205638__12450.0007193.981595[325, 197]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_205638__124.json100.0missingmissingmissing
11276Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_230843__27100.0005131.519430[325, 94]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230843__271.json0.0missingmissingmissing
11277Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231225_230844__97800.0005571.332010[325, 116]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_230844__978.json0.0missingmissingmissing
11278Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_205953__25300.0005111.542520[325, 93]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205953__253.json0.0missingmissingmissing
11279Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse520231227_205954__92800.0005531.567710[325, 114]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_205954__928.json0.0missingmissingmissing
11280Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse520231215_201758__42200.02.67870[325, 98]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_201758__422.json0.00.9missing0.1
11281Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse520231213_205634__12900.0005643.115270[324, 120]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_205634__129.json0.0missingmissingmissing
11282Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_230841__26150.000451.02545[324, 63]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_230841__261.json100.0missingmissingmissing
11283Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231225_230842__92150.0003980.7702045[324, 37]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_230842__921.json100.0missingmissingmissing
11284Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue520231227_205721__99450.00040.8918735[324, 38]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_205721__994.json100.0missingmissingmissing
11285Apple-MacBook-Pro-M1timezone_bumpergpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTtruetrue520231215_201756__90150.01.566275[324, 37]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_201756__901.json100.00.9missing0.1
11286Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewInJulia1SHOTtruetrue520240201_114207__80250.0169937.73525[67, 544]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_114207__802.json100.0missingmissingmissing
11287Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewInJulia1SHOTtruetrue520240201_114236__45450.0145328.18115[67, 462]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_114236__454.json100.0missingmissingmissing
11288Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewInJulia1SHOTtruetrue520240201_114314__60450.0147738.74215[67, 470]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_114314__604.json100.0missingmissingmissing
11289Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewInJulia1SHOTtruefalse520240201_114405__62200.0154650.12110[67, 493]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_114405__622.json25.0missingmissingmissing
11290Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewInJulia1SHOTtruetrue520240201_114443__13950.0152838.28515[67, 487]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_114443__139.json100.0missingmissingmissing
11291Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_113807__54650.002942.900565[102, 64]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_113807__546.json100.0missingmissingmissing
11292Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_113816__92750.005378.862285[102, 145]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_113816__927.json100.0missingmissingmissing
11293Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_113822__91850.003215.879665[102, 73]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_113822__918.json100.0missingmissingmissing
11294Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_113827__77950.003184.550995[102, 72]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_113827__779.json100.0missingmissingmissing
11295Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue520240201_113835__87550.003547.890285[102, 84]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_113835__875.json100.0missingmissingmissing
11296Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_113641__89850.011214.52495[181, 313]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_113641__898.json100.0missingmissingmissing
11297Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_113647__21950.003675.890145[181, 62]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_113647__219.json100.0missingmissingmissing
11298Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_113656__73450.006798.974095[181, 166]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_113656__734.json100.0missingmissingmissing
11299Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_113717__59050.0115620.21575[181, 325]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_113717__590.json100.0missingmissingmissing
11300Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue520240201_113738__72350.0091321.41825[181, 244]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_113738__723.json100.0missingmissingmissing
11301Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_115425__99950.0169349.52135[325, 456]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_115425__999.json100.0missingmissingmissing
11302Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapCoTTask1SHOTfalsefalse520240201_115459__64000.0183134.36840[325, 502]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_115459__640.json0.0missingmissingmissing
11303Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_115514__60850.0103914.60495[325, 238]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_115514__608.json100.0missingmissingmissing
11304Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_115604__27950.021449.74235[325, 605]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_115604__279.json100.0missingmissingmissing
11305Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue520240201_115630__37550.0159725.82035[325, 424]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_115630__375.json100.0missingmissingmissing
11306Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_114807__37150.0209751.09365[324, 591]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_114807__371.json100.0missingmissingmissing
11307Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_114900__91150.0176753.37945[324, 481]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_114900__911.json100.0missingmissingmissing
11308Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_114938__85050.0213338.30675[324, 603]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_114938__850.json100.0missingmissingmissing
11309Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_115004__18050.0134724.9945[324, 341]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_115004__180.json100.0missingmissingmissing
11310Apple-MacBook-Pro-M1timezone_bumpergpt-4-0125-previewJuliaRecapTask1SHOTtruetrue520240201_115044__36850.0217540.24045[324, 617]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_115044__368.json100.0missingmissingmissing
11311Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewAsIs1SHOTtruetrue520231213_205909__23350.013649.4165[64, 432]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_205909__233.json100.0missingmissingmissing
11312Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewAsIs1SHOTtruetrue520231225_231000__35850.0121916.13315[64, 385]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_231000__358.json100.0missingmissingmissing
11313Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewAsIs1SHOTtruetrue520231225_231015__80650.0139914.54115[64, 445]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_231015__806.json100.0missingmissingmissing
11314Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-preview--optimAsIs1SHOTtruefalse520231215_201944__96200.027.37720[64, 325]0.10.0-DEV51.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_201944__962.json25.00.1missing0.9
11315Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewInJulia1SHOTfalsefalse520231213_205819__79800.0195754.63290[67, 630]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_205819__798.json0.0missingmissingmissing
11316Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewInJulia1SHOTtruetrue520231225_230927__97650.0125212.52945[67, 395]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_230927__976.json100.0missingmissingmissing
11317Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewInJulia1SHOTtruetrue520231225_230944__97750.0131517.01635[67, 416]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_230944__977.json100.0missingmissingmissing
11318Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewInJulia1SHOTtruetrue520231227_210130__66450.0124341.06915[67, 392]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_210130__664.json100.0missingmissingmissing
11319Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewInJulia1SHOTtruefalse520231227_210154__18300.0133623.99830[67, 423]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_210154__183.json25.0missingmissingmissing
11320Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-preview--optimInJulia1SHOTtruetrue520231215_201916__96150.031.97825[67, 435]0.10.0-DEV51.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_201916__961.json100.00.1missing0.9
11321Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231213_205724__71350.0056424.52745[102, 154]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_205724__713.json100.0missingmissingmissing
11322Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_230910__88250.004384.116615[102, 112]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_230910__882.json100.0missingmissingmissing
11323Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231225_230914__64250.005284.241275[102, 142]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_230914__642.json100.0missingmissingmissing
11324Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_210037__51050.0054311.98315[102, 147]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_210037__510.json100.0missingmissingmissing
11325Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue520231227_210049__81850.0053411.04165[102, 144]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_210049__818.json100.0missingmissingmissing
11326Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue520231215_201844__47150.012.5025[102, 134]0.10.0-DEV51.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_201844__471.json100.00.1missing0.9
11327Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231213_205700__50250.0087121.35445[181, 230]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_205700__502.json100.0missingmissingmissing
11328Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_230854__84850.009229.463985[181, 247]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230854__848.json100.0missingmissingmissing
11329Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231225_230905__84950.0102711.38715[181, 282]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_230905__849.json100.0missingmissingmissing
11330Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_210009__69850.0106315.28925[181, 294]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210009__698.json100.0missingmissingmissing
11331Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue520231227_210025__55350.0100615.78665[181, 275]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210025__553.json100.0missingmissingmissing
11332Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue520231215_201832__72050.033.40245[181, 246]0.10.0-DEV51.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_201832__720.json100.00.1missing0.9
11333Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231213_210005__34750.0127621.79085[325, 317]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210005__347.json100.0missingmissingmissing
11334Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_231110__36750.0192719.28295[325, 534]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231110__367.json100.0missingmissingmissing
11335Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231225_231135__15050.0196623.96675[325, 547]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231135__150.json100.0missingmissingmissing
11336Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_210340__72150.016626.30965[325, 445]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210340__721.json100.0missingmissingmissing
11337Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue520231227_210404__25950.0129424.06655[325, 323]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210404__259.json100.0missingmissingmissing
11338Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue520231215_202112__31750.039.02145[325, 451]0.10.0-DEV51.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202112__317.json100.00.1missing0.9
11339Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231213_205943__11350.0142833.95245[324, 368]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_205943__113.json100.0missingmissingmissing
11340Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_231035__20850.0153320.1325[324, 403]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_231035__208.json100.0missingmissingmissing
11341Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231225_231051__60550.0170116.00925[324, 459]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_231051__605.json100.0missingmissingmissing
11342Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapTask1SHOTtruetrue520231227_210235__42850.0180940.9725[324, 495]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_210235__428.json100.0missingmissingmissing
11343Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-previewJuliaRecapTask1SHOTtruefalse520231227_210313__50000.016538.29310[324, 442]0.10.0-DEV51.0{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_210313__500.json25.0missingmissingmissing
11344Apple-MacBook-Pro-M1timezone_bumpergpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue520231215_202033__54550.048.7035[324, 479]0.10.0-DEV51.0{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_202033__545.json100.00.1missing0.9
11345Apple-MacBook-Pro-M1timezone_bumperllama2AsIs1SHOTfalsefalse520231214_084337__61600.010.4630[57, 317]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__AsIs__1SHOT__20231214_084337__616.json0.0missingmissingmissing
11346Apple-MacBook-Pro-M1timezone_bumperllama2AsIs1SHOTfalsefalse520231225_084054__97900.011.62920[57, 350]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__AsIs__1SHOT__20231225_084054__979.json0.0missing{\n "num_gpu": 99\n}missing
11347Apple-MacBook-Pro-M1timezone_bumperllama2AsIs1SHOTfalsefalse520231225_084105__73200.010.44630[1, 327]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__AsIs__1SHOT__20231225_084105__732.json0.0missing{\n "num_gpu": 99\n}missing
11348Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruetrue520231214_084327__13510.012.02940[74, 359]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231214_084327__135.json55.0missingmissingmissing
11349Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTfalsefalse520231225_084032__37500.013.85080[74, 410]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231225_084032__375.json0.0missing{\n "num_gpu": 99\n}missing
11350Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruetrue520231225_084042__78410.010.5490[1, 330]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231225_084042__784.json55.0missing{\n "num_gpu": 99\n}missing
11351Apple-MacBook-Pro-M1timezone_bumperllama2InJulia1SHOTtruetrue520231227_084652__62310.015.33820[74, 461]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__InJulia__1SHOT__20231227_084652__623.json55.0missing{\n "num_gpu": 99\n}missing
11352Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231214_084314__64110.09.364550[103, 268]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_084314__641.json55.0missingmissingmissing
11353Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231225_084009__40610.07.601190[103, 215]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_084009__406.json55.0missing{\n "num_gpu": 99\n}missing
11354Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231225_084018__26610.07.547590[1, 235]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_084018__266.json55.0missing{\n "num_gpu": 99\n}missing
11355Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertAsk1SHOTtruetrue520231227_084636__91710.08.140640[103, 236]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_084636__917.json55.0missing{\n "num_gpu": 99\n}missing
11356Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231214_084305__28410.022.79250[201, 607]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084305__284.json55.0missingmissingmissing
11357Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231225_083948__10210.030.40590[219, 667]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_083948__102.json55.0missing{\n "num_gpu": 99\n}missing
11358Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231225_084001__82110.012.99210[1, 381]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084001__821.json55.0missing{\n "num_gpu": 99\n}missing
11359Apple-MacBook-Pro-M1timezone_bumperllama2JuliaExpertCoTTask1SHOTtruetrue520231227_084628__22010.025.37010[219, 554]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084628__220.json55.0missing{\n "num_gpu": 99\n}missing
11360Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruefalse520231214_084419__37700.024.35390[11, 650]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084419__377.json25.0missingmissingmissing
11361Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruetrue520231225_084207__43910.023.3770[11, 628]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084207__439.json55.0missing{\n "num_gpu": 99\n}missing
11362Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruetrue520231225_084229__38810.021.60940[1, 588]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084229__388.json55.0missing{\n "num_gpu": 99\n}missing
11363Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapCoTTask1SHOTtruetrue520231227_084733__35310.021.65280[11, 590]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084733__353.json55.0missing{\n "num_gpu": 99\n}missing
11364Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTfalsefalse520231214_084355__60900.017.67270[374, 400]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_084355__609.json0.0missingmissingmissing
11365Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTtruetrue520231225_084129__25310.024.0170[374, 564]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_084129__253.json55.0missing{\n "num_gpu": 99\n}missing
11366Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTtruetrue520231225_084144__99910.015.07350[1, 420]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_084144__999.json55.0missing{\n "num_gpu": 99\n}missing
11367Apple-MacBook-Pro-M1timezone_bumperllama2JuliaRecapTask1SHOTtruetrue520231227_084711__42510.019.36380[374, 451]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_084711__425.json55.0missing{\n "num_gpu": 99\n}missing
11368Apple-MacBook-Pro-M1timezone_bumpermagicoderAsIs1SHOTfalsefalse520231214_085327__82800.015.0970[57, 452]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__AsIs__1SHOT__20231214_085327__828.json0.0missingmissingmissing
11369Apple-MacBook-Pro-M1timezone_bumpermagicoderAsIs1SHOTtruetrue520231225_090147__94520.05.159351[71, 165]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__AsIs__1SHOT__20231225_090147__945.json65.0missing{\n "num_gpu": 99\n}missing
11370Apple-MacBook-Pro-M1timezone_bumpermagicoderAsIs1SHOTtruetrue520231225_090153__33350.05.135285[71, 165]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__AsIs__1SHOT__20231225_090153__333.json100.0missing{\n "num_gpu": 99\n}missing
11371Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruetrue520231214_085312__59510.010.44090[74, 312]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231214_085312__595.json55.0missingmissingmissing
11372Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruetrue520231225_090137__86850.08.577395[74, 283]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231225_090137__868.json100.0missing{\n "num_gpu": 99\n}missing
11373Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruetrue520231225_090142__34920.05.038041[74, 161]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231225_090142__349.json65.0missing{\n "num_gpu": 99\n}missing
11374Apple-MacBook-Pro-M1timezone_bumpermagicoderInJulia1SHOTtruefalse520231227_085758__23800.06.251180[74, 201]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__InJulia__1SHOT__20231227_085758__238.json25.0missing{\n "num_gpu": 99\n}missing
11375Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTfalsefalse520231214_085301__31000.011.61110[103, 334]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_085301__310.json0.0missingmissingmissing
11376Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruetrue520231225_090121__91520.08.940391[113, 289]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_090121__915.json65.0missing{\n "num_gpu": 99\n}missing
11377Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruetrue520231225_090128__57150.07.715555[113, 247]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_090128__571.json100.0missing{\n "num_gpu": 99\n}missing
11378Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertAsk1SHOTtruetrue520231227_085751__32650.06.657425[113, 209]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_085751__326.json100.0missing{\n "num_gpu": 99\n}missing
11379Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTfalsefalse520231214_085250__75500.017.56460[201, 467]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085250__755.json0.0missingmissingmissing
11380Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_090104__64650.016.24055[211, 314]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090104__646.json100.0missing{\n "num_gpu": 99\n}missing
11381Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruetrue520231225_090112__35950.07.446675[211, 221]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090112__359.json100.0missing{\n "num_gpu": 99\n}missing
11382Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaExpertCoTTask1SHOTtruetrue520231227_085745__41650.014.16515[211, 250]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085745__416.json100.0missing{\n "num_gpu": 99\n}missing
11383Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTfalsefalse520231214_085406__80600.021.08460[11, 562]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085406__806.json0.0missingmissingmissing
11384Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_090229__80520.012.4791[377, 355]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090229__805.json65.0missing{\n "num_gpu": 99\n}missing
11385Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTtruetrue520231225_090237__64350.08.095495[377, 214]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090237__643.json100.0missing{\n "num_gpu": 99\n}missing
11386Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapCoTTask1SHOTtruetrue520231227_085819__86320.010.14731[377, 278]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085819__863.json65.0missing{\n "num_gpu": 99\n}missing
11387Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruetrue520231214_085345__24710.018.32370[374, 417]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_085345__247.json55.0missingmissingmissing
11388Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruetrue520231225_090203__53220.09.945661[374, 274]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_090203__532.json65.0missing{\n "num_gpu": 99\n}missing
11389Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruefalse520231225_090216__18600.013.13220[374, 376]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_090216__186.json25.0missing{\n "num_gpu": 99\n}missing
11390Apple-MacBook-Pro-M1timezone_bumpermagicoderJuliaRecapTask1SHOTtruetrue520231227_085808__14420.010.73771[374, 297]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_085808__144.json65.0missing{\n "num_gpu": 99\n}missing
11391Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_183057__90720.014.97171[74, 289]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183057__907.json65.0missing{\n "num_gpu": 99\n}missing
11392Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_183115__63120.017.75071[74, 344]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183115__631.json65.0missing{\n "num_gpu": 99\n}missing
11393Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue520231227_183122__49020.07.119591[74, 133]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183122__490.json65.0missing{\n "num_gpu": 99\n}missing
11394Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_183009__20620.010.54851[113, 185]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183009__206.json65.0missing{\n "num_gpu": 99\n}missing
11395Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue520231227_183025__11420.015.25281[113, 290]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183025__114.json65.0missing{\n "num_gpu": 99\n}missing
11396Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruefalse520231227_183042__88400.016.9880[113, 324]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183042__884.json25.0missing{\n "num_gpu": 99\n}missing
11397Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182930__10350.016.61865[211, 304]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182930__103.json100.0missing{\n "num_gpu": 99\n}missing
11398Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182946__12620.015.64961[211, 284]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182946__126.json65.0missing{\n "num_gpu": 99\n}missing
11399Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_182959__15720.013.16171[211, 230]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_182959__157.json65.0missing{\n "num_gpu": 99\n}missing
11400Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_183220__58520.010.02251[377, 154]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183220__585.json65.0missing{\n "num_gpu": 99\n}missing
11401Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_183238__40720.017.51411[377, 301]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183238__407.json65.0missing{\n "num_gpu": 99\n}missing
11402Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruefalse520231227_183256__92900.018.34060[377, 315]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183256__929.json25.0missing{\n "num_gpu": 99\n}missing
11403Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruefalse520231227_183138__75400.016.69350[374, 285]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183138__754.json25.0missing{\n "num_gpu": 99\n}missing
11404Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_183155__53050.016.49995[374, 280]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183155__530.json100.0missing{\n "num_gpu": 99\n}missing
11405Apple-MacBook-Pro-M1timezone_bumpermagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue520231227_183210__51320.014.67431[374, 246]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183210__513.json65.0missing{\n "num_gpu": 99\n}missing
11406Apple-MacBook-Pro-M1timezone_bumpermistral-mediumAsIs1SHOTtruetrue520231213_210201__15250.001407893.453645[69, 151]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__AsIs__1SHOT__20231213_210201__152.json100.0missingmissingmissing
11407Apple-MacBook-Pro-M1timezone_bumpermistral-mediumAsIs1SHOTtruetrue520231225_231410__31050.001699136.612375[69, 187]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__AsIs__1SHOT__20231225_231410__310.json100.0missingmissingmissing
11408Apple-MacBook-Pro-M1timezone_bumpermistral-mediumAsIs1SHOTtruetrue520231225_231427__46950.0032362316.1875[69, 377]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__AsIs__1SHOT__20231225_231427__469.json100.0missingmissingmissing
11409Apple-MacBook-Pro-M1timezone_bumpermistral-medium--optimAsIs1SHOTtruetrue520231215_202323__14150.022.86915[69, 327]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__AsIs__1SHOT__20231215_202323__141.json100.00.9missing0.3
11410Apple-MacBook-Pro-M1timezone_bumpermistral-mediumInJulia1SHOTtruetrue520231213_210157__36640.003438498.850624[72, 401]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__InJulia__1SHOT__20231213_210157__366.json90.0missingmissingmissing
11411Apple-MacBook-Pro-M1timezone_bumpermistral-mediumInJulia1SHOTtruetrue520231225_231353__56350.002953097.638335[72, 341]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__InJulia__1SHOT__20231225_231353__563.json100.0missingmissingmissing
11412Apple-MacBook-Pro-M1timezone_bumpermistral-mediumInJulia1SHOTtruetrue520231225_231404__29850.0034061310.4365[72, 397]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__InJulia__1SHOT__20231225_231404__298.json100.0missingmissingmissing
11413Apple-MacBook-Pro-M1timezone_bumpermistral-mediumInJulia1SHOTtruetrue520231227_210621__73750.003058267.908265[72, 354]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__InJulia__1SHOT__20231227_210621__737.json100.0missingmissingmissing
11414Apple-MacBook-Pro-M1timezone_bumpermistral-mediumInJulia1SHOTtruetrue520231227_210626__60350.00205515.159695[72, 230]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__InJulia__1SHOT__20231227_210626__603.json100.0missingmissingmissing
11415Apple-MacBook-Pro-M1timezone_bumpermistral-medium--optimInJulia1SHOTtruetrue520231215_202300__37850.014.03245[72, 163]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__InJulia__1SHOT__20231215_202300__378.json100.00.9missing0.3
11416Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertAsk1SHOTtruetrue520231213_210148__74010.001877256.485330[111, 195]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_210148__740.json55.0missingmissingmissing
11417Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_231342__64150.001804444.317485[111, 186]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_231342__641.json100.0missingmissingmissing
11418Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertAsk1SHOTtruetrue520231225_231346__40150.001731633.971865[111, 177]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_231346__401.json100.0missingmissingmissing
11419Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_210605__23950.0019905113.92555[111, 209]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_210605__239.json100.0missingmissingmissing
11420Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertAsk1SHOTtruetrue520231227_210613__70050.002249397.672595[111, 241]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_210613__700.json100.0missingmissingmissing
11421Apple-MacBook-Pro-M1timezone_bumpermistral-medium--optimJuliaExpertAsk1SHOTtruetrue520231215_202246__85450.013.50795[111, 151]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_202246__854.json100.00.9missing0.3
11422Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231213_210142__71950.0046012140.1525[209, 499]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210142__719.json100.0missingmissingmissing
11423Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_231326__61150.004131999.954935[209, 441]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231326__611.json100.0missingmissingmissing
11424Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231225_231337__80450.0043746910.60455[209, 471]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231337__804.json100.0missingmissingmissing
11425Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_210536__72350.0048196413.78685[209, 526]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210536__723.json100.0missingmissingmissing
11426Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaExpertCoTTask1SHOTtruetrue520231227_210551__87850.0042533414.99755[209, 456]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210551__878.json100.0missingmissingmissing
11427Apple-MacBook-Pro-M1timezone_bumpermistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue520231215_202232__40350.033.75695[209, 435]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202232__403.json100.00.9missing0.3
11428Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231213_210219__62850.004229628.994075[374, 398]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210219__628.json100.0missingmissingmissing
11429Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_231454__13750.004391429.553275[374, 418]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231454__137.json100.0missingmissingmissing
11430Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231225_231508__58510.0059123413.8495[374, 606]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231508__585.json80.0missingmissingmissing
11431Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_210735__59150.0063572943.41895[374, 661]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210735__591.json100.0missingmissingmissing
11432Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapCoTTask1SHOTtruetrue520231227_210803__26250.0052894127.45665[374, 529]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210803__262.json100.0missingmissingmissing
11433Apple-MacBook-Pro-M1timezone_bumpermistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue520231215_202352__15050.018.11375[374, 432]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202352__150.json100.00.9missing0.3
11434Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapTask1SHOTtruetrue520231213_210210__42150.004286249.268035[371, 406]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_210210__421.json100.0missingmissingmissing
11435Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_231440__85250.0046907413.30955[371, 456]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_231440__852.json100.0missingmissingmissing
11436Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapTask1SHOTtruetrue520231225_231444__98150.002482174.191315[371, 183]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_231444__981.json100.0missingmissingmissing
11437Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapTask1SHOTtruetrue520231227_210634__98050.003614777.395845[371, 323]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_210634__980.json100.0missingmissingmissing
11438Apple-MacBook-Pro-M1timezone_bumpermistral-mediumJuliaRecapTask1SHOTtruetrue520231227_210652__17050.0061712118.08115[371, 639]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_210652__170.json100.0missingmissingmissing
11439Apple-MacBook-Pro-M1timezone_bumpermistral-medium--optimJuliaRecapTask1SHOTtruetrue520231215_202334__11550.011.40975[371, 502]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_202334__115.json100.00.9missing0.3
11440Apple-MacBook-Pro-M1timezone_bumpermistral-smallAsIs1SHOTtruetrue520231213_210051__21750.0006162964.031785[68, 295]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__AsIs__1SHOT__20231213_210051__217.json100.0missingmissingmissing
11441Apple-MacBook-Pro-M1timezone_bumpermistral-smallAsIs1SHOTtruetrue520231225_231250__38250.0003912562.548395[68, 179]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__AsIs__1SHOT__20231225_231250__382.json100.0missingmissingmissing
11442Apple-MacBook-Pro-M1timezone_bumpermistral-smallAsIs1SHOTfalsefalse520231225_231253__75000.0004436362.909470[68, 206]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__AsIs__1SHOT__20231225_231253__750.json0.0missingmissingmissing
11443Apple-MacBook-Pro-M1timezone_bumpermistral-small--optimAsIs1SHOTfalsefalse520231215_202145__22200.04.567420[68, 345]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__AsIs__1SHOT__20231215_202145__222.json0.00.9missing0.3
11444Apple-MacBook-Pro-M1timezone_bumpermistral-smallInJulia1SHOTtruetrue520231213_210047__86250.0005580973.616695[71, 264]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__InJulia__1SHOT__20231213_210047__862.json100.0missingmissingmissing
11445Apple-MacBook-Pro-M1timezone_bumpermistral-smallInJulia1SHOTtruetrue520231225_231244__60610.0008723775.673630[71, 426]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__InJulia__1SHOT__20231225_231244__606.json55.0missingmissingmissing
11446Apple-MacBook-Pro-M1timezone_bumpermistral-smallInJulia1SHOTtruetrue520231225_231247__97610.0004067772.628310[71, 186]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__InJulia__1SHOT__20231225_231247__976.json55.0missingmissingmissing
11447Apple-MacBook-Pro-M1timezone_bumpermistral-smallInJulia1SHOTtruetrue520231227_210453__39610.0004513972.860160[71, 209]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__InJulia__1SHOT__20231227_210453__396.json55.0missingmissingmissing
11448Apple-MacBook-Pro-M1timezone_bumpermistral-smallInJulia1SHOTtruetrue520231227_210458__76450.0006803174.816055[71, 327]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__InJulia__1SHOT__20231227_210458__764.json100.0missingmissingmissing
11449Apple-MacBook-Pro-M1timezone_bumpermistral-small--optimInJulia1SHOTtruetrue520231215_202140__11250.03.247185[71, 241]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__InJulia__1SHOT__20231215_202140__112.json100.00.9missing0.3
11450Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertAsk1SHOTtruetrue520231213_210043__18850.0003557042.084515[112, 146]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_210043__188.json100.0missingmissingmissing
11451Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_231237__29310.0003828642.225370[112, 160]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_231237__293.json55.0missingmissingmissing
11452Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertAsk1SHOTtruetrue520231225_231239__79150.0003052641.792265[112, 120]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_231239__791.json100.0missingmissingmissing
11453Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_210448__57350.0003731642.14555[112, 155]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_210448__573.json100.0missingmissingmissing
11454Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertAsk1SHOTtruetrue520231227_210450__95950.0004139042.45565[112, 176]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_210450__959.json100.0missingmissingmissing
11455Apple-MacBook-Pro-M1timezone_bumpermistral-small--optimJuliaExpertAsk1SHOTtruetrue520231215_202137__14450.02.33275[112, 166]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_202137__144.json100.00.9missing0.3
11456Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231213_210041__23010.000999175.969630[210, 445]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210041__230.json55.0missingmissingmissing
11457Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_231230__50550.000746974.401965[210, 315]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231230__505.json100.0missingmissingmissing
11458Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231225_231234__35810.000789654.597120[210, 337]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231234__358.json55.0missingmissingmissing
11459Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_210440__17850.000754734.371535[210, 319]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210440__178.json100.0missingmissingmissing
11460Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaExpertCoTTask1SHOTtruetrue520231227_210445__58510.000954555.651440[210, 422]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210445__585.json55.0missingmissingmissing
11461Apple-MacBook-Pro-M1timezone_bumpermistral-small--optimJuliaExpertCoTTask1SHOTtruetrue520231215_202134__16250.04.504935[210, 339]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202134__162.json100.00.9missing0.3
11462Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231213_210101__64710.001133096.235450[378, 458]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210101__647.json55.0missingmissingmissing
11463Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_231312__84950.001146676.351965[378, 465]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231312__849.json100.0missingmissingmissing
11464Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231225_231316__29510.0008362664.210960[378, 305]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231316__295.json55.0missingmissingmissing
11465Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_210517__14310.001078775.874260[378, 430]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210517__143.json55.0missingmissingmissing
11466Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapCoTTask1SHOTtruetrue520231227_210522__90710.0009604265.034480[378, 369]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210522__907.json55.0missingmissingmissing
11467Apple-MacBook-Pro-M1timezone_bumpermistral-small--optimJuliaRecapCoTTask1SHOTtruetrue520231215_202158__25350.06.725835[378, 499]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202158__253.json100.00.9missing0.3
11468Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapTask1SHOTtruetrue520231213_210055__15550.0008272124.124295[376, 301]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_210055__155.json100.0missingmissingmissing
11469Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapTask1SHOTtruetrue520231225_231258__88450.001015395.43495[376, 398]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_231258__884.json100.0missingmissingmissing
11470Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapTask1SHOTtruetrue520231225_231306__12510.001269537.173170[376, 529]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_231306__125.json55.0missingmissingmissing
11471Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapTask1SHOTtruetrue520231227_210503__52410.0009843525.186950[376, 382]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_210503__524.json55.0missingmissingmissing
11472Apple-MacBook-Pro-M1timezone_bumpermistral-smallJuliaRecapTask1SHOTtruetrue520231227_210511__92750.001399518.073115[376, 596]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_210511__927.json100.0missingmissingmissing
11473Apple-MacBook-Pro-M1timezone_bumpermistral-small--optimJuliaRecapTask1SHOTtruetrue520231215_202151__81710.06.724390[376, 501]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_202151__817.json55.00.9missing0.3
11474Apple-MacBook-Pro-M1timezone_bumpermistral-tinyAsIs1SHOTfalsefalse520231213_210023__62200.0001626344.607710[68, 338]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__AsIs__1SHOT__20231213_210023__622.json0.0missingmissingmissing
11475Apple-MacBook-Pro-M1timezone_bumpermistral-tinyAsIs1SHOTfalsefalse520231225_231203__13800.0002554994.793640[68, 543]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__AsIs__1SHOT__20231225_231203__138.json0.0missingmissingmissing
11476Apple-MacBook-Pro-M1timezone_bumpermistral-tinyAsIs1SHOTfalsefalse520231225_231207__88300.0002464394.687110[68, 523]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__AsIs__1SHOT__20231225_231207__883.json0.0missingmissingmissing
11477Apple-MacBook-Pro-M1timezone_bumpermistral-tiny--optimAsIs1SHOTfalsefalse520231215_202123__34200.02.933860[68, 351]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__AsIs__1SHOT__20231215_202123__342.json0.00.9missing0.3
11478Apple-MacBook-Pro-M1timezone_bumpermistral-tinyInJulia1SHOTtruetrue520231213_210018__85819.7369e-52.366010[71, 193]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__InJulia__1SHOT__20231213_210018__858.json55.0missingmissingmissing
11479Apple-MacBook-Pro-M1timezone_bumpermistral-tinyInJulia1SHOTtruetrue520231225_231152__15150.0001109591.975465[71, 223]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__InJulia__1SHOT__20231225_231152__151.json100.0missingmissingmissing
11480Apple-MacBook-Pro-M1timezone_bumpermistral-tinyInJulia1SHOTtruetrue520231225_231158__79410.0003075615.909480[71, 657]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__InJulia__1SHOT__20231225_231158__794.json55.0missingmissingmissing
11481Apple-MacBook-Pro-M1timezone_bumpermistral-tinyInJulia1SHOTtruetrue520231227_210421__18318.9215e-51.619770[71, 175]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__InJulia__1SHOT__20231227_210421__183.json55.0missingmissingmissing
11482Apple-MacBook-Pro-M1timezone_bumpermistral-tinyInJulia1SHOTtruetrue520231227_210423__77619.3745e-51.745990[71, 185]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__InJulia__1SHOT__20231227_210423__776.json55.0missingmissingmissing
11483Apple-MacBook-Pro-M1timezone_bumpermistral-tiny--optimInJulia1SHOTtruetrue520231215_202120__72110.01.914880[71, 229]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__InJulia__1SHOT__20231215_202120__721.json55.00.9missing0.3
11484Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertAsk1SHOTtruetrue520231213_210016__54214.5578e-51.445250[112, 66]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_210016__542.json55.0missingmissingmissing
11485Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_231149__89214.6937e-50.7703830[112, 69]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_231149__892.json55.0missingmissingmissing
11486Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertAsk1SHOTtruetrue520231225_231150__87014.6937e-50.7840660[112, 69]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_231150__870.json55.0missingmissingmissing
11487Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_210419__55515.5091e-50.8826590[112, 87]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_210419__555.json55.0missingmissingmissing
11488Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertAsk1SHOTtruetrue520231227_210420__19014.6937e-50.7296720[112, 69]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_210420__190.json55.0missingmissingmissing
11489Apple-MacBook-Pro-M1timezone_bumpermistral-tiny--optimJuliaExpertAsk1SHOTtruetrue520231215_202118__67610.00.7214360[112, 69]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_202118__676.json55.00.9missing0.3
11490Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231213_210014__26410.0002450289.506810[210, 476]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210014__264.json55.0missingmissingmissing
11491Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_231143__28010.0002192078.603390[210, 419]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231143__280.json55.0missingmissingmissing
11492Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231225_231148__68710.0002504644.577010[210, 488]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231148__687.json55.0missingmissingmissing
11493Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_210415__26550.00023234411.03895[210, 448]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210415__265.json100.0missingmissingmissing
11494Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaExpertCoTTask1SHOTtruetrue520231227_210418__89610.0001711892.925390[210, 313]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210418__896.json55.0missingmissingmissing
11495Apple-MacBook-Pro-M1timezone_bumpermistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue520231215_202117__42610.05.074320[210, 325]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202117__426.json55.00.9missing0.3
11496Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231213_210035__33750.0002241546.442825[378, 378]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210035__337.json100.0missingmissingmissing
11497Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_231221__69910.0001919912.952680[378, 307]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231221__699.json55.0missingmissingmissing
11498Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231225_231225__68610.0002481634.030235[378, 431]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231225__686.json80.0missingmissingmissing
11499Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_210433__97110.0001688882.464810[378, 256]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210433__971.json55.0missingmissingmissing
11500Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapCoTTask1SHOTtruetrue520231227_210435__96810.0001494092.212540[378, 213]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210435__968.json55.0missingmissingmissing
11501Apple-MacBook-Pro-M1timezone_bumpermistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue520231215_202130__45410.02.959520[378, 345]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202130__454.json55.00.9missing0.3
11502Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapTask1SHOTfalsefalse520231213_210028__24500.0002234215.152130[376, 377]0.10.0-DEV51.0{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_210028__245.json0.0missingmissingmissing
11503Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapTask1SHOTtruetrue520231225_231212__84210.0002646444.39790[376, 468]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_231212__842.json55.0missingmissingmissing
11504Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapTask1SHOTtruetrue520231225_231218__14610.0003452786.013620[376, 646]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_231218__146.json55.0missingmissingmissing
11505Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapTask1SHOTtruetrue520231227_210427__74210.0002447123.948945[376, 424]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_210427__742.json80.0missingmissingmissing
11506Apple-MacBook-Pro-M1timezone_bumpermistral-tinyJuliaRecapTask1SHOTtruetrue520231227_210430__18050.0001948822.980685[376, 314]0.10.0-DEV51.0{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_210430__180.json100.0missingmissingmissing
11507Apple-MacBook-Pro-M1timezone_bumpermistral-tiny--optimJuliaRecapTask1SHOTtruetrue520231215_202126__99810.03.47980[376, 295]0.10.0-DEV51.0{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_202126__998.json55.00.9missing0.3
11508Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_092902__52200.012.94870[67, 327]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_092902__522.json0.0missing{\n "num_gpu": 99\n}missing
11509Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse520231225_092916__47800.013.75320[67, 348]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_092916__478.json0.0missing{\n "num_gpu": 99\n}missing
11510Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_092841__82310.04.747090[70, 113]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_092841__823.json55.0missing{\n "num_gpu": 99\n}missing
11511Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231225_092849__86410.07.489310[70, 185]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_092849__864.json55.0missing{\n "num_gpu": 99\n}missing
11512Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue520231227_090850__29410.011.44870[70, 286]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_090850__294.json55.0missing{\n "num_gpu": 99\n}missing
11513Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092829__48510.03.057390[111, 63]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092829__485.json55.0missing{\n "num_gpu": 99\n}missing
11514Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092836__36610.07.68750[111, 185]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092836__366.json55.0missing{\n "num_gpu": 99\n}missing
11515Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse520231227_090839__59500.03.330010[111, 70]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090839__595.json0.0missing{\n "num_gpu": 99\n}missing
11516Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_092809__49310.022.56070[209, 408]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092809__493.json55.0missing{\n "num_gpu": 99\n}missing
11517Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_092826__33310.015.92420[209, 381]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092826__333.json55.0missing{\n "num_gpu": 99\n}missing
11518Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_090835__14110.012.98020[209, 168]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090835__141.json55.0missing{\n "num_gpu": 99\n}missing
11519Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093015__36910.017.63420[378, 395]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093015__369.json55.0missing{\n "num_gpu": 99\n}missing
11520Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093023__24510.07.717220[378, 147]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093023__245.json55.0missing{\n "num_gpu": 99\n}missing
11521Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_090927__31610.026.4370[378, 605]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090927__316.json55.0missing{\n "num_gpu": 99\n}missing
11522Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092932__47310.016.34750[376, 364]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092932__473.json55.0missing{\n "num_gpu": 99\n}missing
11523Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092957__40610.025.00850[376, 576]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092957__406.json55.0missing{\n "num_gpu": 99\n}missing
11524Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_090900__70600.09.978510[376, 203]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_090900__706.json25.0missing{\n "num_gpu": 99\n}missing
11525Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004250__50110.010.83770[69, 343]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004250__501.json55.0missing{\n "num_gpu": 99\n}missing
11526Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004256__38510.06.242950[69, 193]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004256__385.json55.0missing{\n "num_gpu": 99\n}missing
11527Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004304__12450.07.638965[69, 238]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004304__124.json100.0missing{\n "num_gpu": 99\n}missing
11528Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004311__90050.06.992945[69, 218]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004311__900.json100.0missing{\n "num_gpu": 99\n}missing
11529Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue520231228_004324__45910.012.93560[69, 410]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_004324__459.json55.0missing{\n "num_gpu": 99\n}missing
11530Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004228__54510.02.968690[110, 78]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004228__545.json55.0missing{\n "num_gpu": 99\n}missing
11531Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004230__38610.02.648960[110, 69]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004230__386.json55.0missing{\n "num_gpu": 99\n}missing
11532Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004233__88410.02.751020[110, 72]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004233__884.json55.0missing{\n "num_gpu": 99\n}missing
11533Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004236__67150.02.804375[110, 74]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004236__671.json100.0missing{\n "num_gpu": 99\n}missing
11534Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue520231228_004239__62850.03.099715[110, 84]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_004239__628.json100.0missing{\n "num_gpu": 99\n}missing
11535Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruefalse520231228_004143__49900.022.82540[208, 663]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004143__499.json25.0missing{\n "num_gpu": 99\n}missing
11536Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004152__52210.09.282330[208, 269]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004152__522.json55.0missing{\n "num_gpu": 99\n}missing
11537Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004201__70250.08.653015[208, 249]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004201__702.json100.0missing{\n "num_gpu": 99\n}missing
11538Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004212__29210.011.6640[208, 345]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004212__292.json55.0missing{\n "num_gpu": 99\n}missing
11539Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue520231228_004224__34510.011.91890[208, 353]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004224__345.json55.0missing{\n "num_gpu": 99\n}missing
11540Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004440__16050.08.980665[377, 231]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004440__160.json100.0missing{\n "num_gpu": 99\n}missing
11541Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004451__78110.011.29650[377, 303]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004451__781.json55.0missing{\n "num_gpu": 99\n}missing
11542Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruefalse520231228_004503__29400.011.44830[377, 308]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004503__294.json25.0missing{\n "num_gpu": 99\n}missing
11543Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004519__13510.016.38210[377, 459]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004519__135.json55.0missing{\n "num_gpu": 99\n}missing
11544Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue520231228_004541__56210.021.9385[377, 625]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_004541__562.json80.0missing{\n "num_gpu": 99\n}missing
11545Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004339__49410.015.05960[375, 419]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004339__494.json55.0missing{\n "num_gpu": 99\n}missing
11546Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004351__28910.011.34380[375, 305]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004351__289.json55.0missing{\n "num_gpu": 99\n}missing
11547Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004408__81510.016.54480[375, 464]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004408__815.json55.0missing{\n "num_gpu": 99\n}missing
11548Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004421__66110.013.00640[375, 357]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004421__661.json55.0missing{\n "num_gpu": 99\n}missing
11549Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue520231228_004431__38510.010.08790[375, 266]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_004431__385.json55.0missing{\n "num_gpu": 99\n}missing
11550Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004736__31710.08.154330[69, 200]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004736__317.json55.0missing{\n "num_gpu": 99\n}missing
11551Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004747__13710.010.20720[69, 253]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004747__137.json55.0missing{\n "num_gpu": 99\n}missing
11552Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004756__35210.09.437060[69, 233]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004756__352.json55.0missing{\n "num_gpu": 99\n}missing
11553Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004805__99610.08.284050[69, 203]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004805__996.json55.0missing{\n "num_gpu": 99\n}missing
11554Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue520231228_004812__36610.07.457340[69, 182]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_004812__366.json55.0missing{\n "num_gpu": 99\n}missing
11555Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004710__18710.06.891940[110, 162]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004710__187.json55.0missing{\n "num_gpu": 99\n}missing
11556Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004713__97010.03.389110[110, 71]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004713__970.json55.0missing{\n "num_gpu": 99\n}missing
11557Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004717__87610.03.778850[110, 81]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004717__876.json55.0missing{\n "num_gpu": 99\n}missing
11558Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004724__38510.06.846710[110, 161]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004724__385.json55.0missing{\n "num_gpu": 99\n}missing
11559Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue520231228_004728__85310.03.893850[110, 84]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_004728__853.json55.0missing{\n "num_gpu": 99\n}missing
11560Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004548__66210.07.208530[208, 135]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004548__662.json55.0missing{\n "num_gpu": 99\n}missing
11561Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004606__96610.017.55580[208, 417]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004606__966.json55.0missing{\n "num_gpu": 99\n}missing
11562Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004622__13310.015.63030[208, 369]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004622__133.json55.0missing{\n "num_gpu": 99\n}missing
11563Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231228_004645__97010.023.14090[208, 555]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004645__970.json55.0missing{\n "num_gpu": 99\n}missing
11564Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231228_004703__18300.017.83310[208, 424]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_004703__183.json0.0missing{\n "num_gpu": 99\n}missing
11565Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005002__99210.018.1050[377, 402]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005002__992.json55.0missing{\n "num_gpu": 99\n}missing
11566Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005014__87710.012.20090[377, 257]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005014__877.json55.0missing{\n "num_gpu": 99\n}missing
11567Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005026__18710.011.76970[377, 246]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005026__187.json55.0missing{\n "num_gpu": 99\n}missing
11568Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005037__25010.010.91940[377, 225]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005037__250.json55.0missing{\n "num_gpu": 99\n}missing
11569Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231228_005051__28850.013.49445[377, 288]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005051__288.json100.0missing{\n "num_gpu": 99\n}missing
11570Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004825__60510.012.35830[375, 261]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004825__605.json55.0missing{\n "num_gpu": 99\n}missing
11571Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse520231228_004842__95700.017.4870[375, 387]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004842__957.json25.0missing{\n "num_gpu": 99\n}missing
11572Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004901__24010.018.46390[375, 411]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004901__240.json55.0missing{\n "num_gpu": 99\n}missing
11573Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004925__92610.024.03785[375, 546]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004925__926.json80.0missing{\n "num_gpu": 99\n}missing
11574Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue520231228_004944__46310.019.07110[375, 426]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_004944__463.json55.0missing{\n "num_gpu": 99\n}missing
11575Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_124221__64900.021.38360[66, 389]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_124221__649.json0.0missing{\n "num_gpu": 99\n}missing
11576Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse520231226_124238__14800.017.01880[66, 307]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_124238__148.json0.0missing{\n "num_gpu": 99\n}missing
11577Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_124148__51310.09.987670[69, 180]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124148__513.json55.0missing{\n "num_gpu": 99\n}missing
11578Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231226_124159__80810.011.04990[69, 197]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124159__808.json55.0missing{\n "num_gpu": 99\n}missing
11579Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue520231227_091234__23010.011.65930[69, 211]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_091234__230.json55.0missing{\n "num_gpu": 99\n}missing
11580Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_124133__44910.04.072620[110, 64]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124133__449.json55.0missing{\n "num_gpu": 99\n}missing
11581Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231226_124138__51150.05.017715[110, 82]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124138__511.json100.0missing{\n "num_gpu": 99\n}missing
11582Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue520231227_091222__92510.04.250230[110, 67]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_091222__925.json55.0missing{\n "num_gpu": 99\n}missing
11583Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231226_124121__13610.025.3290[208, 448]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124121__136.json55.0missing{\n "num_gpu": 99\n}missing
11584Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse520231226_124129__75000.07.563310[208, 120]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124129__750.json25.0missing{\n "num_gpu": 99\n}missing
11585Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue520231227_091218__85610.031.07740[208, 394]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091218__856.json55.0missing{\n "num_gpu": 99\n}missing
11586Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231226_124344__59710.019.04550[377, 310]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124344__597.json55.0missing{\n "num_gpu": 99\n}missing
11587Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruefalse520231226_124431__80600.047.06130[377, 735]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124431__806.json25.0missing{\n "num_gpu": 99\n}missing
11588Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231227_091330__33450.031.16925[377, 531]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091330__334.json100.0missing{\n "num_gpu": 99\n}missing
11589Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_124249__48010.011.17450[375, 167]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124249__480.json55.0missing{\n "num_gpu": 99\n}missing
11590Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231226_124324__83710.035.40755[375, 598]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124324__837.json80.0missing{\n "num_gpu": 99\n}missing
11591Apple-MacBook-Pro-M1timezone_bumpermistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruetrue520231227_091259__67710.025.08540[375, 421]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_091259__677.json55.0missing{\n "num_gpu": 99\n}missing
11592Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_091715__49510.056.37070[75, 333]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_091715__495.json55.0missing{\n "num_gpu": 99\n}missing
11593Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruefalse520231227_132525__32500.050.0380[75, 295]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_132525__325.json25.0missing{\n "num_gpu": 99\n}missing
11594Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_132559__98350.033.70195[75, 195]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_132559__983.json100.0missing{\n "num_gpu": 99\n}missing
11595Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue520231227_132637__76650.037.7665[75, 220]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_132637__766.json100.0missing{\n "num_gpu": 99\n}missing
11596Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_091619__23310.053.86780[114, 312]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_091619__233.json55.0missing{\n "num_gpu": 99\n}missing
11597Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_132350__31510.046.21780[114, 266]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_132350__315.json55.0missing{\n "num_gpu": 99\n}missing
11598Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_132406__97610.016.24750[114, 82]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_132406__976.json55.0missing{\n "num_gpu": 99\n}missing
11599Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_132435__21810.028.88710[114, 160]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_132435__218.json55.0missing{\n "num_gpu": 99\n}missing
11600Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_091525__84150.069.71175[210, 251]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091525__841.json100.0missing{\n "num_gpu": 99\n}missing
11601Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_132208__32210.072.8155[210, 380]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_132208__322.json80.0missing{\n "num_gpu": 99\n}missing
11602Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_132231__69300.022.25390[210, 104]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_132231__693.json0.0missing{\n "num_gpu": 99\n}missing
11603Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse520231227_132304__85700.032.56020[210, 167]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_132304__857.json0.0missing{\n "num_gpu": 99\n}missing
11604Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_091914__16310.070.32831[388, 358]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091914__163.json60.0missing{\n "num_gpu": 99\n}missing
11605Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse520231227_133009__26900.011.0370[388, 5]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133009__269.json0.0missing{\n "num_gpu": 99\n}missing
11606Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_133111__38110.061.73470[388, 308]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133111__381.json55.0missing{\n "num_gpu": 99\n}missing
11607Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_133225__10810.074.72230[388, 384]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133225__108.json55.0missing{\n "num_gpu": 99\n}missing
11608Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_091803__51010.047.98295[386, 226]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_091803__510.json80.0missing{\n "num_gpu": 99\n}missing
11609Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_132738__13250.061.37555[386, 306]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_132738__132.json100.0missing{\n "num_gpu": 99\n}missing
11610Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruefalse520231227_132844__67500.065.96280[386, 333]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_132844__675.json25.0missing{\n "num_gpu": 99\n}missing
11611Apple-MacBook-Pro-M1timezone_bumpernous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_132958__31010.073.28950[386, 376]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_132958__310.json55.0missing{\n "num_gpu": 99\n}missing
11612Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_093139__10200.017.22950[75, 436]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_093139__102.json0.0missing{\n "num_gpu": 99\n}missing
11613Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse520231225_093148__80400.09.343670[75, 233]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_093148__804.json0.0missing{\n "num_gpu": 99\n}missing
11614Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_093115__38740.08.512724[78, 211]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_093115__387.json90.0missing{\n "num_gpu": 99\n}missing
11615Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231225_093121__99550.06.331915[78, 154]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_093121__995.json100.0missing{\n "num_gpu": 99\n}missing
11616Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue520231227_090954__14250.05.111815[78, 121]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_090954__142.json100.0missing{\n "num_gpu": 99\n}missing
11617Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_093100__66550.06.525835[119, 154]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_093100__665.json100.0missing{\n "num_gpu": 99\n}missing
11618Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_093106__44910.06.333450[119, 149]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_093106__449.json55.0missing{\n "num_gpu": 99\n}missing
11619Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_090949__82850.03.190255[119, 66]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090949__828.json100.0missing{\n "num_gpu": 99\n}missing
11620Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_093042__26850.018.7525[217, 296]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093042__268.json100.0missing{\n "num_gpu": 99\n}missing
11621Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_093053__82750.011.50985[217, 268]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093053__827.json100.0missing{\n "num_gpu": 99\n}missing
11622Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231227_090946__63840.018.91964[217, 303]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090946__638.json90.0missing{\n "num_gpu": 99\n}missing
11623Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093225__85650.010.32645[386, 209]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093225__856.json100.0missing{\n "num_gpu": 99\n}missing
11624Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_093230__43510.05.183870[386, 78]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093230__435.json55.0missing{\n "num_gpu": 99\n}missing
11625Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_091023__93110.013.81860[386, 294]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091023__931.json55.0missing{\n "num_gpu": 99\n}missing
11626Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_093207__55240.019.30374[384, 435]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_093207__552.json90.0missing{\n "num_gpu": 99\n}missing
11627Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_093214__74650.07.17395[384, 133]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_093214__746.json100.0missing{\n "num_gpu": 99\n}missing
11628Apple-MacBook-Pro-M1timezone_bumperopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_091009__67010.014.70930[384, 320]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_091009__670.json55.0missing{\n "num_gpu": 99\n}missing
11629Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralAsIs1SHOTfalsefalse520231214_084508__66600.015.72210[57, 469]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_084508__666.json0.0missingmissingmissing
11630Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralAsIs1SHOTfalsefalse520231225_084346__37100.012.47570[73, 407]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_084346__371.json0.0missing{\n "num_gpu": 99\n}missing
11631Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231214_084452__10310.011.73720[74, 349]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_084452__103.json55.0missingmissingmissing
11632Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_084329__96810.012.01580[76, 391]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_084329__968.json55.0missing{\n "num_gpu": 99\n}missing
11633Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231225_084334__87110.04.566780[76, 141]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_084334__871.json55.0missing{\n "num_gpu": 99\n}missing
11634Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralInJulia1SHOTtruetrue520231227_084805__90450.05.71735[76, 179]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_084805__904.json100.0missing{\n "num_gpu": 99\n}missing
11635Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231214_084440__34710.08.580270[103, 245]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_084440__347.json55.0missingmissingmissing
11636Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_084311__31110.04.380590[117, 130]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_084311__311.json55.0missing{\n "num_gpu": 99\n}missing
11637Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231225_084317__20620.05.409215[117, 165]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_084317__206.json85.0missing{\n "num_gpu": 99\n}missing
11638Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue520231227_084800__74110.04.277260[117, 125]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_084800__741.json55.0missing{\n "num_gpu": 99\n}missing
11639Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231214_084431__77810.012.16760[201, 317]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084431__778.json55.0missingmissingmissing
11640Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse520231225_084307__79800.013.88970[215, 426]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084307__798.json25.0missing{\n "num_gpu": 99\n}missing
11641Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue520231227_084755__61350.022.06785[215, 523]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084755__613.json100.0missing{\n "num_gpu": 99\n}missing
11642Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231214_084542__31700.011.43920[11, 318]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084542__317.json0.0missingmissingmissing
11643Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231225_084431__93610.014.31540[384, 407]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084431__936.json55.0missing{\n "num_gpu": 99\n}missing
11644Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse520231225_084450__10500.019.15790[384, 557]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084450__105.json0.0missing{\n "num_gpu": 99\n}missing
11645Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue520231227_084832__24150.014.80275[384, 418]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084832__241.json100.0missing{\n "num_gpu": 99\n}missing
11646Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231214_084531__49110.022.77110[374, 532]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_084531__491.json55.0missingmissingmissing
11647Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_084409__38110.010.07540[382, 273]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_084409__381.json55.0missing{\n "num_gpu": 99\n}missing
11648Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231225_084416__99010.06.748940[382, 166]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_084416__990.json55.0missing{\n "num_gpu": 99\n}missing
11649Apple-MacBook-Pro-M1timezone_bumperopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue520231227_084817__98800.011.70320[382, 321]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_084817__988.json50.0missing{\n "num_gpu": 99\n}missing
11650Apple-MacBook-Pro-M1timezone_bumperorca2:13bAsIs1SHOTfalsefalse520231214_085656__45100.010.12540[57, 307]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__AsIs__1SHOT__20231214_085656__451.json0.0missingmissingmissing
11651Apple-MacBook-Pro-M1timezone_bumperorca2:13bAsIs1SHOTfalsefalse520231225_090520__33700.017.29630[74, 316]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__AsIs__1SHOT__20231225_090520__337.json0.0missing{\n "num_gpu": 99\n}missing
11652Apple-MacBook-Pro-M1timezone_bumperorca2:13bAsIs1SHOTfalsefalse520231225_090523__82700.02.7560[74, 38]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__AsIs__1SHOT__20231225_090523__827.json0.0missing{\n "num_gpu": 99\n}missing
11653Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231214_085646__46510.010.65280[74, 318]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231214_085646__465.json55.0missingmissingmissing
11654Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231225_090453__40650.014.31165[77, 260]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231225_090453__406.json100.0missing{\n "num_gpu": 99\n}missing
11655Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231225_090503__15250.09.373745[77, 166]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231225_090503__152.json100.0missing{\n "num_gpu": 99\n}missing
11656Apple-MacBook-Pro-M1timezone_bumperorca2:13bInJulia1SHOTtruetrue520231227_085925__62450.09.81625[77, 173]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__InJulia__1SHOT__20231227_085925__624.json100.0missing{\n "num_gpu": 99\n}missing
11657Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTtruetrue520231214_085635__50010.08.319860[103, 236]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_085635__500.json55.0missingmissingmissing
11658Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_090436__45600.02.929990[116, 37]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_090436__456.json0.0missing{\n "num_gpu": 99\n}missing
11659Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTfalsefalse520231225_090439__31300.03.321450[116, 44]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_090439__313.json0.0missing{\n "num_gpu": 99\n}missing
11660Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertAsk1SHOTtruetrue520231227_085915__24220.014.47341[116, 255]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_085915__242.json65.0missing{\n "num_gpu": 99\n}missing
11661Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231214_085626__93210.020.82740[201, 555]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085626__932.json55.0missingmissingmissing
11662Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231225_090408__65800.016.71170[214, 106]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090408__658.json0.0missing{\n "num_gpu": 99\n}missing
11663Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTtruetrue520231225_090433__38640.025.10494[214, 434]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090433__386.json90.0missing{\n "num_gpu": 99\n}missing
11664Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaExpertCoTTask1SHOTfalsefalse520231227_085900__13300.013.68470[214, 52]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085900__133.json0.0missing{\n "num_gpu": 99\n}missing
11665Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231214_085733__70110.016.05750[11, 440]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085733__701.json55.0missingmissingmissing
11666Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_090648__78710.026.26030[380, 420]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090648__787.json55.0missing{\n "num_gpu": 99\n}missing
11667Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231225_090717__11540.028.86974[380, 465]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090717__115.json90.0missing{\n "num_gpu": 99\n}missing
11668Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapCoTTask1SHOTtruetrue520231227_085953__72810.016.11630[380, 238]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085953__728.json55.0missing{\n "num_gpu": 99\n}missing
11669Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTtruetrue520231214_085717__98210.021.2940[374, 495]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_085717__982.json55.0missingmissingmissing
11670Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_090544__91900.020.86840[377, 325]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_090544__919.json0.0missing{\n "num_gpu": 99\n}missing
11671Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTfalsefalse520231225_090621__80400.037.58610[377, 615]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_090621__804.json0.0missing{\n "num_gpu": 99\n}missing
11672Apple-MacBook-Pro-M1timezone_bumperorca2:13bJuliaRecapTask1SHOTfalsefalse520231227_085937__71400.012.05770[377, 165]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_085937__714.json0.0missing{\n "num_gpu": 99\n}missing
11673Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_093536__45900.054.99010[68, 1863]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_093536__459.json0.0missing{\n "num_gpu": 99\n}missing
11674Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse520231225_093553__42600.017.60020[68, 671]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_093553__426.json0.0missing{\n "num_gpu": 99\n}missing
11675Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_093427__31100.018.25860[71, 695]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_093427__311.json0.0missing{\n "num_gpu": 99\n}missing
11676Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231225_093441__44800.013.51810[71, 521]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_093441__448.json0.0missing{\n "num_gpu": 99\n}missing
11677Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse520231227_091115__92800.018.52060[71, 697]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_091115__928.json0.0missing{\n "num_gpu": 99\n}missing
11678Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_093334__71200.028.60520[108, 1041]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_093334__712.json0.0missing{\n "num_gpu": 99\n}missing
11679Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231225_093409__21000.034.58770[108, 1235]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_093409__210.json0.0missing{\n "num_gpu": 99\n}missing
11680Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse520231227_091057__51500.023.81230[108, 872]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_091057__515.json0.0missing{\n "num_gpu": 99\n}missing
11681Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_093236__94300.05.665030[197, 54]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093236__943.json0.0missing{\n "num_gpu": 99\n}missing
11682Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231225_093305__13700.029.57080[197, 1045]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_093305__137.json0.0missing{\n "num_gpu": 99\n}missing
11683Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse520231227_091033__25900.010.05130[197, 233]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091033__259.json0.0missing{\n "num_gpu": 99\n}missing
11684Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231225_093610__60400.04.215130[360, 117]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093610__604.json0.0missing{\n "num_gpu": 99\n}missing
11685Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTtruetrue520231225_093618__25910.07.872150[360, 254]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_093618__259.json55.0missing{\n "num_gpu": 99\n}missing
11686Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse520231227_091147__13900.023.32380[360, 787]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_091147__139.json0.0missing{\n "num_gpu": 99\n}missing
11687Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231225_093602__97810.08.893390[357, 291]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_093602__978.json55.0missing{\n "num_gpu": 99\n}missing
11688Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse520231225_093605__40800.03.378040[357, 84]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_093605__408.json0.0missing{\n "num_gpu": 99\n}missing
11689Apple-MacBook-Pro-M1timezone_bumperphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTtruetrue520231227_091123__46110.08.099560[357, 260]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_091123__461.json55.0missing{\n "num_gpu": 99\n}missing
11690Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2AsIs1SHOTfalsefalse520231214_085837__69000.017.66680[57, 523]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_085837__690.json0.0missingmissingmissing
11691Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2AsIs1SHOTtruetrue520231225_091136__27750.049.49195[82, 388]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_091136__277.json100.0missing{\n "num_gpu": 99\n}missing
11692Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2AsIs1SHOTfalsefalse520231225_091230__90700.054.0280[82, 424]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_091230__907.json0.0missing{\n "num_gpu": 99\n}missing
11693Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231214_085819__41810.012.59250[74, 374]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_085819__418.json55.0missingmissingmissing
11694Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_091025__61650.040.26285[85, 314]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_091025__616.json100.0missing{\n "num_gpu": 99\n}missing
11695Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231225_091047__23250.021.64645[85, 162]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_091047__232.json100.0missing{\n "num_gpu": 99\n}missing
11696Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2InJulia1SHOTtruetrue520231227_090137__38750.020.22265[85, 150]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_090137__387.json100.0missing{\n "num_gpu": 99\n}missing
11697Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231214_085807__81110.010.57120[103, 304]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_085807__811.json55.0missingmissingmissing
11698Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_090919__13410.023.83520[124, 175]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_090919__134.json55.0missing{\n "num_gpu": 99\n}missing
11699Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231225_090945__49450.025.85325[124, 191]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_090945__494.json100.0missing{\n "num_gpu": 99\n}missing
11700Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue520231227_090117__20450.033.10745[124, 248]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_090117__204.json100.0missing{\n "num_gpu": 99\n}missing
11701Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231214_085756__40110.022.45530[201, 597]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085756__401.json55.0missingmissingmissing
11702Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_090809__43550.051.86285[222, 206]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090809__435.json100.0missing{\n "num_gpu": 99\n}missing
11703Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231225_090855__93150.045.97555[222, 335]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090855__931.json100.0missing{\n "num_gpu": 99\n}missing
11704Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue520231227_090044__97750.050.98885[222, 208]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090044__977.json100.0missing{\n "num_gpu": 99\n}missing
11705Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231214_085923__10010.015.75390[11, 432]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085923__100.json55.0missingmissingmissing
11706Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_091418__73450.027.385[388, 153]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_091418__734.json100.0missing{\n "num_gpu": 99\n}missing
11707Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231225_091512__29330.053.7634[388, 360]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_091512__293.json85.0missing{\n "num_gpu": 99\n}missing
11708Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue520231227_090254__42450.033.87495[388, 203]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090254__424.json100.0missing{\n "num_gpu": 99\n}missing
11709Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231214_085908__23710.030.64260[374, 726]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_085908__237.json55.0missingmissingmissing
11710Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_091314__80950.043.25965[385, 278]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_091314__809.json100.0missing{\n "num_gpu": 99\n}missing
11711Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue520231225_091351__70150.037.29545[385, 231]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_091351__701.json100.0missing{\n "num_gpu": 99\n}missing
11712Apple-MacBook-Pro-M1timezone_bumperphind-codellama:34b-v2JuliaRecapTask1SHOTtruefalse520231227_090220__89000.042.3940[385, 270]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_090220__890.json25.0missing{\n "num_gpu": 99\n}missing
11713Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTtruetrue520231225_092629__51610.014.62120[75, 246]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_092629__516.json55.0missing{\n "num_gpu": 99\n}missing
11714Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTtruetrue520231225_092636__39810.07.007320[75, 112]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_092636__398.json55.0missing{\n "num_gpu": 99\n}missing
11715Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_092609__46410.016.01920[78, 271]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_092609__464.json55.0missing{\n "num_gpu": 99\n}missing
11716Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231225_092614__62550.05.109485[78, 78]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_092614__625.json100.0missing{\n "num_gpu": 99\n}missing
11717Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue520231227_090745__88110.05.367290[78, 82]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_090745__881.json55.0missing{\n "num_gpu": 99\n}missing
11718Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092546__56910.015.02220[119, 248]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092546__569.json55.0missing{\n "num_gpu": 99\n}missing
11719Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231225_092553__54310.07.011940[119, 107]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_092553__543.json55.0missing{\n "num_gpu": 99\n}missing
11720Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue520231227_090740__78150.011.83925[119, 191]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_090740__781.json100.0missing{\n "num_gpu": 99\n}missing
11721Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue520231225_092522__95210.022.48480[217, 199]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092522__952.json55.0missing{\n "num_gpu": 99\n}missing
11722Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231225_092531__46700.08.994210[217, 128]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_092531__467.json25.0missing{\n "num_gpu": 99\n}missing
11723Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruefalse520231227_090728__25300.020.1080[217, 171]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_090728__253.json25.0missing{\n "num_gpu": 99\n}missing
11724Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092728__57010.010.29030[386, 123]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092728__570.json55.0missing{\n "num_gpu": 99\n}missing
11725Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231225_092747__14510.019.12970[386, 273]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_092747__145.json55.0missing{\n "num_gpu": 99\n}missing
11726Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue520231227_090822__61650.017.3725[386, 242]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_090822__616.json100.0missing{\n "num_gpu": 99\n}missing
11727Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092654__33310.018.05660[384, 259]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092654__333.json55.0missing{\n "num_gpu": 99\n}missing
11728Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231225_092717__70710.022.64620[384, 336]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_092717__707.json55.0missing{\n "num_gpu": 99\n}missing
11729Apple-MacBook-Pro-M1timezone_bumpersolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue520231227_090805__23310.019.87790[384, 288]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_090805__233.json55.0missing{\n "num_gpu": 99\n}missing
11730Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrAsIs1SHOTfalsefalse520231214_085505__60700.017.37680[57, 516]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_085505__607.json0.0missingmissingmissing
11731Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrAsIs1SHOTfalsefalse520231225_090322__18400.08.268270[78, 470]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_090322__184.json0.0missing{\n "num_gpu": 99\n}missing
11732Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrAsIs1SHOTfalsefalse520231225_090327__28800.05.784950[78, 333]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_090327__288.json0.0missing{\n "num_gpu": 99\n}missing
11733Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTtruetrue520231214_085448__70410.016.92890[74, 498]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_085448__704.json55.0missingmissingmissing
11734Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTfalsefalse520231225_090307__93000.05.827860[81, 334]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_090307__930.json0.0missing{\n "num_gpu": 99\n}missing
11735Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTfalsefalse520231225_090313__67300.05.984950[81, 344]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_090313__673.json0.0missing{\n "num_gpu": 99\n}missing
11736Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrInJulia1SHOTfalsefalse520231227_085834__97000.03.676440[81, 207]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_085834__970.json0.0missing{\n "num_gpu": 99\n}missing
11737Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231214_085431__45910.07.067110[103, 199]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_085431__459.json55.0missingmissingmissing
11738Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231225_090300__60010.03.482620[118, 193]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_090300__600.json55.0missing{\n "num_gpu": 99\n}missing
11739Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse520231225_090302__70500.01.41020[118, 69]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_090302__705.json0.0missing{\n "num_gpu": 99\n}missing
11740Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertAsk1SHOTtruetrue520231227_085830__86810.01.639070[118, 81]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_085830__868.json55.0missing{\n "num_gpu": 99\n}missing
11741Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231214_085424__83610.017.39310[201, 462]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085424__836.json55.0missingmissingmissing
11742Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse520231225_090248__36700.010.92440[204, 426]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090248__367.json0.0missing{\n "num_gpu": 99\n}missing
11743Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231225_090256__97910.08.609650[204, 454]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_090256__979.json55.0missing{\n "num_gpu": 99\n}missing
11744Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue520231227_085828__61010.09.592170[204, 361]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085828__610.json55.0missing{\n "num_gpu": 99\n}missing
11745Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse520231214_085605__29300.039.84870[11, 1010]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_085605__293.json0.0missingmissingmissing
11746Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_090347__91410.06.354570[368, 291]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090347__914.json55.0missing{\n "num_gpu": 99\n}missing
11747Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231225_090351__21910.03.952710[368, 162]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_090351__219.json55.0missing{\n "num_gpu": 99\n}missing
11748Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue520231227_085846__44610.05.357380[368, 235]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085846__446.json55.0missing{\n "num_gpu": 99\n}missing
11749Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231214_085526__94310.020.16780[374, 465]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_085526__943.json55.0missingmissingmissing
11750Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231225_090336__14400.08.913530[366, 422]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_090336__144.json0.0missing{\n "num_gpu": 99\n}missing
11751Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTtruetrue520231225_090340__68310.03.810810[366, 154]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_090340__683.json55.0missing{\n "num_gpu": 99\n}missing
11752Apple-MacBook-Pro-M1timezone_bumperstablelm-zephyrJuliaRecapTask1SHOTfalsefalse520231227_085841__10500.07.376990[366, 339]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_085841__105.json0.0missing{\n "num_gpu": 99\n}missing
11753Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestAsIs1SHOTfalsefalse520231214_084642__49200.07.846630[57, 238]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_084642__492.json0.0missingmissingmissing
11754Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestAsIs1SHOTfalsefalse520231225_084610__66100.08.600860[75, 277]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_084610__661.json0.0missing{\n "num_gpu": 99\n}missing
11755Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestAsIs1SHOTfalsefalse520231225_084618__36100.08.000230[75, 257]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_084618__361.json0.0missing{\n "num_gpu": 99\n}missing
11756Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231214_084634__35910.016.87860[74, 497]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_084634__359.json55.0missingmissingmissing
11757Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231225_084553__57810.015.10580[78, 491]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_084553__578.json55.0missing{\n "num_gpu": 99\n}missing
11758Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231225_084601__63250.08.181645[78, 263]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_084601__632.json100.0missing{\n "num_gpu": 99\n}missing
11759Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestInJulia1SHOTtruetrue520231227_084911__78010.010.82210[78, 345]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_084911__780.json55.0missing{\n "num_gpu": 99\n}missing
11760Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231214_084617__75110.013.20750[103, 381]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_084617__751.json55.0missingmissingmissing
11761Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_084528__42150.06.176345[119, 190]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_084528__421.json100.0missing{\n "num_gpu": 99\n}missing
11762Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231225_084537__79410.09.132680[119, 288]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_084537__794.json55.0missing{\n "num_gpu": 99\n}missing
11763Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertAsk1SHOTtruetrue520231227_084900__31410.06.865980[119, 211]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_084900__314.json55.0missing{\n "num_gpu": 99\n}missing
11764Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231214_084604__21610.021.9030[201, 583]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084604__216.json55.0missingmissingmissing
11765Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_084514__94910.024.22350[217, 582]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084514__949.json55.0missing{\n "num_gpu": 99\n}missing
11766Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231225_084522__41310.07.690810[217, 223]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084522__413.json55.0missing{\n "num_gpu": 99\n}missing
11767Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue520231227_084853__82110.021.02020[217, 483]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_084853__821.json55.0missing{\n "num_gpu": 99\n}missing
11768Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse520231214_084756__85600.028.90250[11, 760]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084756__856.json0.0missingmissingmissing
11769Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_084649__60750.012.04545[386, 330]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084649__607.json100.0missing{\n "num_gpu": 99\n}missing
11770Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231225_084659__18150.09.241055[386, 241]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_084659__181.json100.0missing{\n "num_gpu": 99\n}missing
11771Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue520231227_084932__15550.011.845[386, 321]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_084932__155.json100.0missing{\n "num_gpu": 99\n}missing
11772Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231214_084727__24610.044.940[374, 1054]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_084727__246.json55.0missingmissingmissing
11773Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_084626__84450.08.217175[384, 212]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_084626__844.json100.0missing{\n "num_gpu": 99\n}missing
11774Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231225_084637__91650.010.75265[384, 294]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_084637__916.json100.0missing{\n "num_gpu": 99\n}missing
11775Apple-MacBook-Pro-M1timezone_bumperstarling-lm:latestJuliaRecapTask1SHOTtruetrue520231227_084921__44450.09.606025[384, 255]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_084921__444.json100.0missing{\n "num_gpu": 99\n}missing
11776Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatAsIs1SHOTfalsefalse520231214_084842__60300.012.04980[57, 363]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_084842__603.json0.0missingmissingmissing
11777Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatAsIs1SHOTtruetrue520231225_085231__15210.052.41130[72, 397]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_085231__152.json55.0missing{\n "num_gpu": 99\n}missing
11778Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatAsIs1SHOTtruetrue520231225_085342__21510.071.55250[72, 543]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_085342__215.json55.0missing{\n "num_gpu": 99\n}missing
11779Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruetrue520231214_084830__81710.010.07610[74, 300]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_084830__817.json55.0missingmissingmissing
11780Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruefalse520231225_085024__65000.063.46360[75, 482]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_085024__650.json25.0missing{\n "num_gpu": 99\n}missing
11781Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruetrue520231225_085138__75810.074.57380[75, 565]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_085138__758.json55.0missing{\n "num_gpu": 99\n}missing
11782Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatInJulia1SHOTtruefalse520231227_085217__46200.071.45760[75, 538]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_085217__462.json25.0missing{\n "num_gpu": 99\n}missing
11783Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231214_084820__25910.07.674460[103, 218]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_084820__259.json55.0missingmissingmissing
11784Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_084857__60610.013.36240[114, 86]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_084857__606.json55.0missing{\n "num_gpu": 99\n}missing
11785Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231225_084920__37610.022.58130[114, 159]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_084920__376.json55.0missing{\n "num_gpu": 99\n}missing
11786Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertAsk1SHOTtruetrue520231227_085105__94310.049.46960[114, 365]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_085105__943.json55.0missing{\n "num_gpu": 99\n}missing
11787Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231214_084812__38410.015.90290[201, 422]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_084812__384.json55.0missingmissingmissing
11788Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_084819__59610.080.54850[210, 404]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084819__596.json55.0missing{\n "num_gpu": 99\n}missing
11789Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue520231225_084844__58210.024.18540[210, 154]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_084844__582.json55.0missing{\n "num_gpu": 99\n}missing
11790Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaExpertCoTTask1SHOTfalsefalse520231227_085016__93400.043.0310[210, 126]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_085016__934.json0.0missing{\n "num_gpu": 99\n}missing
11791Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231214_084928__61710.024.77520[11, 659]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_084928__617.json55.0missingmissingmissing
11792Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_085506__92410.019.59450[388, 86]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085506__924.json55.0missing{\n "num_gpu": 99\n}missing
11793Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue520231225_085622__22410.075.65690[388, 505]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_085622__224.json55.0missing{\n "num_gpu": 99\n}missing
11794Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse520231227_085549__17000.0129.0410[388, 879]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_085549__170.json0.0missing{\n "num_gpu": 99\n}missing
11795Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruetrue520231214_084903__32610.020.82510[374, 481]0.10.0-DEV51.0{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_084903__326.json55.0missingmissingmissing
11796Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_085407__34750.024.98735[386, 127]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_085407__347.json100.0missing{\n "num_gpu": 99\n}missing
11797Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruetrue520231225_085447__33910.039.29920[386, 236]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_085447__339.json55.0missing{\n "num_gpu": 99\n}missing
11798Apple-MacBook-Pro-M1timezone_bumperyi:34b-chatJuliaRecapTask1SHOTtruefalse520231227_085339__37000.082.83390[386, 552]0.10.0-DEV51.0{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/timezone_bumper/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_085339__370.json25.0missing{\n "num_gpu": 99\n}missing
11799Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructAsIs1SHOTfalsefalse620231214_090642__51400.016.96450[48, 506]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231214_090642__514.json0.0missingmissingmissing
11800Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructAsIs1SHOTtruefalse620231225_073210__74400.021.50920[70, 391]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_073210__744.json25.0missing{\n "num_gpu": 99\n}missing
11801Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructAsIs1SHOTtruetrue620231225_073225__40230.014.38152[70, 258]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__AsIs__1SHOT__20231225_073225__402.json87.5missing{\n "num_gpu": 99\n}missing
11802Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTfalsefalse620231214_090625__33500.09.720510[65, 290]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231214_090625__335.json0.0missingmissingmissing
11803Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruetrue620231225_073136__44810.020.84662[73, 377]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_073136__448.json79.1667missing{\n "num_gpu": 99\n}missing
11804Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruetrue620231225_073148__21650.011.9692[73, 212]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231225_073148__216.json95.8333missing{\n "num_gpu": 99\n}missing
11805Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructInJulia1SHOTtruetrue620231227_092722__15350.09.926892[73, 176]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__InJulia__1SHOT__20231227_092722__153.json95.8333missing{\n "num_gpu": 99\n}missing
11806Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse620231214_090616__45300.012.61590[94, 369]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231214_090616__453.json0.0missingmissingmissing
11807Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTtruetrue620231225_073109__39350.08.436322[111, 140]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_073109__393.json95.8333missing{\n "num_gpu": 99\n}missing
11808Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse620231225_073116__34000.06.422570[111, 103]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231225_073116__340.json0.0missing{\n "num_gpu": 99\n}missing
11809Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertAsk1SHOTfalsefalse620231227_092712__71200.07.362740[111, 122]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertAsk__1SHOT__20231227_092712__712.json0.0missing{\n "num_gpu": 99\n}missing
11810Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTfalsefalse620231214_090603__29700.015.43160[175, 418]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090603__297.json0.0missingmissingmissing
11811Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue620231225_073047__98900.023.07350[193, 190]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073047__989.json50.0missing{\n "num_gpu": 99\n}missing
11812Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue620231225_073100__72050.013.66612[193, 218]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073100__720.json95.8333missing{\n "num_gpu": 99\n}missing
11813Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaExpertCoTTask1SHOTtruetrue620231227_092705__25950.024.76192[193, 257]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092705__259.json95.8333missing{\n "num_gpu": 99\n}missing
11814Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse620231214_090727__32300.016.92420[11, 463]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090727__323.json0.0missingmissingmissing
11815Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue620231225_073320__58900.016.33732[376, 239]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073320__589.json75.0missing{\n "num_gpu": 99\n}missing
11816Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTfalsefalse620231225_073341__24300.020.81040[376, 319]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073341__243.json0.0missing{\n "num_gpu": 99\n}missing
11817Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapCoTTask1SHOTtruetrue620231227_092748__73250.013.49912[376, 192]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092748__732.json95.8333missing{\n "num_gpu": 99\n}missing
11818Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231214_090710__19000.027.87370[365, 662]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231214_090710__190.json50.0missingmissingmissing
11819Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231225_073242__87820.017.45112[373, 259]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_073242__878.json83.3333missing{\n "num_gpu": 99\n}missing
11820Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231225_073304__75400.021.38410[373, 327]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231225_073304__754.json50.0missing{\n "num_gpu": 99\n}missing
11821Apple-MacBook-Pro-M1wrap_stringcodellama:13b-instructJuliaRecapTask1SHOTtruetrue620231227_092735__95300.012.15841[373, 168]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct/evaluation__JuliaRecapTask__1SHOT__20231227_092735__953.json62.5missing{\n "num_gpu": 99\n}missing
11822NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054258__45860.02.107062[0, 155]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054258__458.json100.0missing{\n "num_gpu": 99\n}missing
11823NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054301__65430.03.477370[0, 257]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054301__654.json62.5missing{\n "num_gpu": 99\n}missing
11824NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054306__12330.04.64142[0, 342]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054306__123.json87.5missing{\n "num_gpu": 99\n}missing
11825NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054309__28210.02.621410[0, 194]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054309__282.json54.1667missing{\n "num_gpu": 99\n}missing
11826NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054311__35810.02.526712[0, 187]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054311__358.json79.1667missing{\n "num_gpu": 99\n}missing
11827NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054225__81240.01.83772[0, 140]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054225__812.json91.6667missing{\n "num_gpu": 99\n}missing
11828NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054229__92760.04.009162[0, 304]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054229__927.json100.0missing{\n "num_gpu": 99\n}missing
11829NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054233__36750.04.138772[0, 313]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054233__367.json95.8333missing{\n "num_gpu": 99\n}missing
11830NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054236__93320.02.507842[0, 191]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054236__933.json83.3333missing{\n "num_gpu": 99\n}missing
11831NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054238__96660.02.070722[0, 156]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054238__966.json100.0missing{\n "num_gpu": 99\n}missing
11832NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_054159__88800.01.05120[0, 79]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054159__888.json0.0missing{\n "num_gpu": 99\n}missing
11833NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054201__81750.02.10782[0, 159]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054201__817.json95.8333missing{\n "num_gpu": 99\n}missing
11834NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054203__63510.02.382810[0, 180]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054203__635.json54.1667missing{\n "num_gpu": 99\n}missing
11835NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_054205__53100.01.592660[0, 120]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054205__531.json0.0missing{\n "num_gpu": 99\n}missing
11836NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054207__29500.01.95232[0, 148]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054207__295.json75.0missing{\n "num_gpu": 99\n}missing
11837NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620240201_054411__45600.02.19630[0, 163]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054411__456.json0.0missing{\n "num_gpu": 99\n}missing
11838NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054415__80800.04.605372[0, 339]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054415__808.json75.0missing{\n "num_gpu": 99\n}missing
11839NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054422__52500.06.64131[0, 485]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054422__525.json62.5missing{\n "num_gpu": 99\n}missing
11840NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054425__52110.03.302650[0, 244]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054425__521.json54.1667missing{\n "num_gpu": 99\n}missing
11841NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620240201_054430__31200.04.325790[0, 319]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054430__312.json0.0missing{\n "num_gpu": 99\n}missing
11842NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054336__19730.03.460152[0, 254]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054336__197.json87.5missing{\n "num_gpu": 99\n}missing
11843NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054339__64750.03.450912[0, 254]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054339__647.json95.8333missing{\n "num_gpu": 99\n}missing
11844NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054344__14700.05.0342[0, 369]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054344__147.json75.0missing{\n "num_gpu": 99\n}missing
11845NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_054347__76500.02.537630[0, 187]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054347__765.json0.0missing{\n "num_gpu": 99\n}missing
11846NVIDIA-RTX-4090-4xwrap_stringcodellama:13b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054352__69210.05.360222[0, 391]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054352__692.json79.1667missing{\n "num_gpu": 99\n}missing
11847Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonAsIs1SHOTfalsefalse620231214_090823__48500.014.30830[48, 430]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__AsIs__1SHOT__20231214_090823__485.json0.0missingmissingmissing
11848Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonAsIs1SHOTfalsefalse620231225_073437__29000.04.27920[44, 70]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_073437__290.json0.0missing{\n "num_gpu": 99\n}missing
11849Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonAsIs1SHOTfalsefalse620231225_073440__31900.03.066450[44, 47]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__AsIs__1SHOT__20231225_073440__319.json0.0missing{\n "num_gpu": 99\n}missing
11850Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonInJulia1SHOTfalsefalse620231214_090808__67700.012.37960[65, 368]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__InJulia__1SHOT__20231214_090808__677.json0.0missingmissingmissing
11851Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonInJulia1SHOTtruetrue620231225_073421__12900.07.842522[47, 139]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_073421__129.json75.0missing{\n "num_gpu": 99\n}missing
11852Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonInJulia1SHOTfalsefalse620231225_073432__39700.011.00380[47, 194]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__InJulia__1SHOT__20231225_073432__397.json0.0missing{\n "num_gpu": 99\n}missing
11853Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue620231214_090756__94500.010.70070[94, 313]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231214_090756__945.json50.0missingmissingmissing
11854Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertAsk1SHOTtruetrue620231225_073408__77100.07.260650[48, 127]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_073408__771.json50.0missing{\n "num_gpu": 99\n}missing
11855Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertAsk1SHOTtruefalse620231225_073413__57900.05.045070[48, 86]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertAsk__1SHOT__20231225_073413__579.json25.0missing{\n "num_gpu": 99\n}missing
11856Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertCoTTask1SHOTtruetrue620231214_090745__66000.017.57960[175, 478]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090745__660.json50.0missingmissingmissing
11857Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse620231225_073355__35200.013.19160[68, 45]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073355__352.json0.0missing{\n "num_gpu": 99\n}missing
11858Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaExpertCoTTask1SHOTfalsefalse620231225_073401__66100.06.373260[68, 107]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073401__661.json0.0missing{\n "num_gpu": 99\n}missing
11859Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse620231214_090853__12000.010.75160[11, 297]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090853__120.json0.0missingmissingmissing
11860Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse620231225_073448__91200.01.306620[65, 9]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073448__912.json0.0missing{\n "num_gpu": 99\n}missing
11861Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapCoTTask1SHOTfalsefalse620231225_073502__74400.013.32980[65, 210]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073502__744.json0.0missing{\n "num_gpu": 99\n}missing
11862Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapTask1SHOTtruetrue620231214_090842__84600.019.3581[365, 447]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231214_090842__846.json62.5missingmissingmissing
11863Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapTask1SHOTtruefalse620231225_073446__92400.06.066320[62, 103]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_073446__924.json25.0missing{\n "num_gpu": 99\n}missing
11864Apple-MacBook-Pro-M1wrap_stringcodellama:13b-pythonJuliaRecapTask1SHOTfalsefalse620231225_073447__38200.01.066260[62, 8]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:13b-python/evaluation__JuliaRecapTask__1SHOT__20231225_073447__382.json0.0missing{\n "num_gpu": 99\n}missing
11865NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_055017__80250.05.672712[0, 205]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_055017__802.json95.8333missing{\n "num_gpu": 99\n}missing
11866NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_055026__91400.09.131120[0, 330]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_055026__914.json50.0missing{\n "num_gpu": 99\n}missing
11867NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_055038__43660.011.99112[0, 429]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_055038__436.json100.0missing{\n "num_gpu": 99\n}missing
11868NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_055045__96330.06.632762[0, 240]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_055045__963.json87.5missing{\n "num_gpu": 99\n}missing
11869NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_055054__29400.08.762272[0, 317]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_055054__294.json75.0missing{\n "num_gpu": 99\n}missing
11870NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054852__71850.05.159132[0, 186]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054852__718.json95.8333missing{\n "num_gpu": 99\n}missing
11871NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054857__79330.04.988872[0, 180]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054857__793.json87.5missing{\n "num_gpu": 99\n}missing
11872NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054908__85800.010.18440[0, 366]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054908__858.json50.0missing{\n "num_gpu": 99\n}missing
11873NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054914__87450.06.164992[0, 222]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054914__874.json95.8333missing{\n "num_gpu": 99\n}missing
11874NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054921__44750.06.827432[0, 246]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054921__447.json95.8333missing{\n "num_gpu": 99\n}missing
11875NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054742__83900.08.933732[0, 320]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054742__839.json75.0missing{\n "num_gpu": 99\n}missing
11876NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620240201_054747__45500.04.985920[0, 179]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054747__455.json25.0missing{\n "num_gpu": 99\n}missing
11877NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054755__55550.08.301842[0, 297]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054755__555.json95.8333missing{\n "num_gpu": 99\n}missing
11878NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054806__73200.010.53970[0, 377]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054806__732.json50.0missing{\n "num_gpu": 99\n}missing
11879NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054815__82010.08.941452[0, 320]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054815__820.json79.1667missing{\n "num_gpu": 99\n}missing
11880NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_055356__17750.025.00092[0, 885]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_055356__177.json95.8333missing{\n "num_gpu": 99\n}missing
11881NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_055410__50730.013.04352[0, 463]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_055410__507.json87.5missing{\n "num_gpu": 99\n}missing
11882NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620240201_055416__75700.06.068530[0, 216]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_055416__757.json0.0missing{\n "num_gpu": 99\n}missing
11883NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_055433__42310.017.28730[0, 608]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_055433__423.json54.1667missing{\n "num_gpu": 99\n}missing
11884NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620240201_055446__45500.012.92580[0, 454]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_055446__455.json0.0missing{\n "num_gpu": 99\n}missing
11885NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_055156__42800.05.31620[0, 190]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_055156__428.json0.0missing{\n "num_gpu": 99\n}missing
11886NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_055203__58000.07.096412[0, 253]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_055203__580.json75.0missing{\n "num_gpu": 99\n}missing
11887NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_055210__17500.07.074870[0, 252]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_055210__175.json0.0missing{\n "num_gpu": 99\n}missing
11888NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_055242__28850.031.55752[0, 1114]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_055242__288.json95.8333missing{\n "num_gpu": 99\n}missing
11889NVIDIA-RTX-4090-4xwrap_stringcodellama:34b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_055249__55600.06.657130[0, 237]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:34b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_055249__556.json50.0missing{\n "num_gpu": 99\n}missing
11890NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse620240201_053619__51300.021.18850[0, 513]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_053619__513.json0.0missing{\n "num_gpu": 99\n}missing
11891NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue620240201_053630__26840.011.57162[0, 281]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_053630__268.json91.6667missing{\n "num_gpu": 99\n}missing
11892NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue620240201_053641__90340.010.97472[0, 267]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_053641__903.json91.6667missing{\n "num_gpu": 99\n}missing
11893NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KInJulia1SHOTfalsefalse620240201_053700__38000.018.83420[0, 458]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_053700__380.json0.0missing{\n "num_gpu": 99\n}missing
11894NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KInJulia1SHOTtruetrue620240201_053729__38750.029.14851[0, 704]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__InJulia__1SHOT__20240201_053729__387.json83.3333missing{\n "num_gpu": 99\n}missing
11895NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue620240201_053343__57300.015.75411[0, 385]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_053343__573.json62.5missing{\n "num_gpu": 99\n}missing
11896NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue620240201_053358__36630.014.43971[0, 352]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_053358__366.json75.0missing{\n "num_gpu": 99\n}missing
11897NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse620240201_053409__89500.011.63590[0, 286]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_053409__895.json0.0missing{\n "num_gpu": 99\n}missing
11898NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTfalsefalse620240201_053424__93100.014.32620[0, 346]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_053424__931.json0.0missing{\n "num_gpu": 99\n}missing
11899NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertAsk1SHOTtruetrue620240201_053435__75500.011.89471[0, 292]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertAsk__1SHOT__20240201_053435__755.json62.5missing{\n "num_gpu": 99\n}missing
11900NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse620240201_053212__32500.010.53060[0, 255]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_053212__325.json0.0missing{\n "num_gpu": 99\n}missing
11901NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse620240201_053212__83800.00.1284070[0, 3]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_053212__838.json0.0missing{\n "num_gpu": 99\n}missing
11902NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse620240201_053213__32600.00.1263740[0, 3]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_053213__326.json0.0missing{\n "num_gpu": 99\n}missing
11903NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTtruefalse620240201_053223__34300.010.65340[0, 258]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_053223__343.json25.0missing{\n "num_gpu": 99\n}missing
11904NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaExpertCoTTask1SHOTfalsefalse620240201_053226__22700.03.255330[0, 79]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaExpertCoTTask__1SHOT__20240201_053226__227.json0.0missing{\n "num_gpu": 99\n}missing
11905NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse620240201_054041__29900.01.602520[0, 39]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054041__299.json0.0missing{\n "num_gpu": 99\n}missing
11906NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTfalsefalse620240201_054042__51500.01.560810[0, 38]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054042__515.json0.0missing{\n "num_gpu": 99\n}missing
11907NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue620240201_054101__45530.018.09152[0, 437]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054101__455.json87.5missing{\n "num_gpu": 99\n}missing
11908NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruetrue620240201_054116__32120.015.36232[0, 372]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054116__321.json83.3333missing{\n "num_gpu": 99\n}missing
11909NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapCoTTask1SHOTtruefalse620240201_054134__78900.018.53720[0, 448]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054134__789.json25.0missing{\n "num_gpu": 99\n}missing
11910NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse620240201_053852__40600.09.340010[0, 226]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_053852__406.json0.0missing{\n "num_gpu": 99\n}missing
11911NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue620240201_053907__47930.014.66922[0, 354]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_053907__479.json87.5missing{\n "num_gpu": 99\n}missing
11912NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruetrue620240201_053920__95450.013.31242[0, 323]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_053920__954.json95.8333missing{\n "num_gpu": 99\n}missing
11913NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTfalsefalse620240201_053929__82800.08.4910[0, 206]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_053929__828.json0.0missing{\n "num_gpu": 99\n}missing
11914NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q2_KJuliaRecapTask1SHOTtruefalse620240201_053948__70900.018.74890[0, 454]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q2_K/evaluation__JuliaRecapTask__1SHOT__20240201_053948__709.json25.0missing{\n "num_gpu": 99\n}missing
11915NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_052244__71230.023.53541[0, 440]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_052244__712.json75.0missing{\n "num_gpu": 99\n}missing
11916NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_052257__74620.012.74482[0, 238]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_052257__746.json83.3333missing{\n "num_gpu": 99\n}missing
11917NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_052319__42350.021.8452[0, 406]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_052319__423.json95.8333missing{\n "num_gpu": 99\n}missing
11918NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MInJulia1SHOTfalsefalse620240201_052341__55200.021.42660[0, 397]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_052341__552.json0.0missing{\n "num_gpu": 99\n}missing
11919NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_052415__29840.034.81332[0, 645]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_052415__298.json91.6667missing{\n "num_gpu": 99\n}missing
11920NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_051851__15840.026.53592[0, 491]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_051851__158.json91.6667missing{\n "num_gpu": 99\n}missing
11921NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse620240201_051913__16100.022.84580[0, 425]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_051913__161.json0.0missing{\n "num_gpu": 99\n}missing
11922NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse620240201_051926__20900.012.02990[0, 225]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_051926__209.json0.0missing{\n "num_gpu": 99\n}missing
11923NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse620240201_051947__56900.021.23230[0, 396]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_051947__569.json0.0missing{\n "num_gpu": 99\n}missing
11924NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse620240201_052006__92400.019.17080[0, 358]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_052006__924.json0.0missing{\n "num_gpu": 99\n}missing
11925NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_051559__54100.011.04590[0, 204]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_051559__541.json0.0missing{\n "num_gpu": 99\n}missing
11926NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_051623__53400.024.78121[0, 457]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_051623__534.json62.5missing{\n "num_gpu": 99\n}missing
11927NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_051630__22000.06.394020[0, 119]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_051630__220.json0.0missing{\n "num_gpu": 99\n}missing
11928NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_051654__18700.024.06050[0, 444]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_051654__187.json0.0missing{\n "num_gpu": 99\n}missing
11929NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_051657__32000.03.104440[0, 58]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_051657__320.json0.0missing{\n "num_gpu": 99\n}missing
11930NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_052919__97810.016.18092[0, 299]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_052919__978.json79.1667missing{\n "num_gpu": 99\n}missing
11931NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620240201_052942__15200.023.25680[0, 422]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_052942__152.json0.0missing{\n "num_gpu": 99\n}missing
11932NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_053006__52400.023.54931[0, 427]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_053006__524.json62.5missing{\n "num_gpu": 99\n}missing
11933NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse620240201_053021__28100.015.32540[0, 283]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_053021__281.json25.0missing{\n "num_gpu": 99\n}missing
11934NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_053048__40550.027.36112[0, 503]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_053048__405.json95.8333missing{\n "num_gpu": 99\n}missing
11935NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_052605__47000.019.07610[0, 351]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_052605__470.json0.0missing{\n "num_gpu": 99\n}missing
11936NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_052628__74700.022.98010[0, 424]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_052628__747.json0.0missing{\n "num_gpu": 99\n}missing
11937NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_052641__86600.012.81940[0, 237]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_052641__866.json0.0missing{\n "num_gpu": 99\n}missing
11938NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_052702__35510.020.90972[0, 385]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_052702__355.json79.1667missing{\n "num_gpu": 99\n}missing
11939NVIDIA-RTX-4090-4xwrap_stringcodellama:70b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620240201_052711__63600.09.186860[0, 170]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:70b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_052711__636.json0.0missing{\n "num_gpu": 99\n}missing
11940NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054525__10040.03.400382[0, 406]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054525__100.json91.6667missing{\n "num_gpu": 99\n}missing
11941NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054527__30630.02.726052[0, 328]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054527__306.json87.5missing{\n "num_gpu": 99\n}missing
11942NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054530__74600.02.308260[0, 278]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054530__746.json50.0missing{\n "num_gpu": 99\n}missing
11943NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MInJulia1SHOTtruetrue620240201_054533__26850.02.822992[0, 338]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054533__268.json95.8333missing{\n "num_gpu": 99\n}missing
11944NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MInJulia1SHOTtruefalse620240201_054535__86700.02.224070[0, 267]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20240201_054535__867.json25.0missing{\n "num_gpu": 99\n}missing
11945NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTfalsefalse620240201_054502__49700.00.9955480[0, 119]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054502__497.json0.0missing{\n "num_gpu": 99\n}missing
11946NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054503__32900.01.422740[0, 171]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054503__329.json50.0missing{\n "num_gpu": 99\n}missing
11947NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054506__33010.02.514140[0, 300]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054506__330.json54.1667missing{\n "num_gpu": 99\n}missing
11948NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054507__70130.01.234072[0, 148]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054507__701.json87.5missing{\n "num_gpu": 99\n}missing
11949NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620240201_054509__82340.01.671032[0, 201]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20240201_054509__823.json91.6667missing{\n "num_gpu": 99\n}missing
11950NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054446__41250.01.861272[0, 222]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054446__412.json95.8333missing{\n "num_gpu": 99\n}missing
11951NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_054447__42900.01.280160[0, 153]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054447__429.json0.0missing{\n "num_gpu": 99\n}missing
11952NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054449__75950.01.97812[0, 234]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054449__759.json95.8333missing{\n "num_gpu": 99\n}missing
11953NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620240201_054451__19300.01.180990[0, 141]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054451__193.json0.0missing{\n "num_gpu": 99\n}missing
11954NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620240201_054452__64710.01.473290[0, 175]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20240201_054452__647.json54.1667missing{\n "num_gpu": 99\n}missing
11955NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruefalse620240201_054617__11200.01.345940[0, 158]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054617__112.json25.0missing{\n "num_gpu": 99\n}missing
11956NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054620__92600.03.042312[0, 351]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054620__926.json75.0missing{\n "num_gpu": 99\n}missing
11957NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054623__81850.02.049012[0, 235]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054623__818.json95.8333missing{\n "num_gpu": 99\n}missing
11958NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054624__92350.01.513752[0, 178]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054624__923.json95.8333missing{\n "num_gpu": 99\n}missing
11959NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620240201_054628__40430.03.693192[0, 429]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20240201_054628__404.json87.5missing{\n "num_gpu": 99\n}missing
11960NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054549__87940.01.829142[0, 215]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054549__879.json91.6667missing{\n "num_gpu": 99\n}missing
11961NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054551__96530.02.235322[0, 262]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054551__965.json87.5missing{\n "num_gpu": 99\n}missing
11962NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054553__24800.01.605772[0, 189]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054553__248.json75.0missing{\n "num_gpu": 99\n}missing
11963NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054555__17120.01.910580[0, 225]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054555__171.json58.3333missing{\n "num_gpu": 99\n}missing
11964NVIDIA-RTX-4090-4xwrap_stringcodellama:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620240201_054557__27520.02.048892[0, 241]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/codellama:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20240201_054557__275.json83.3333missing{\n "num_gpu": 99\n}missing
11965Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue620231225_075816__35000.061.19530[62, 340]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_075816__350.json50.0missing{\n "num_gpu": 99\n}missing
11966Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MAsIs1SHOTtruetrue620231225_075911__80510.054.630[62, 328]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_075911__805.json54.1667missing{\n "num_gpu": 99\n}missing
11967Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_075628__84800.059.02521[65, 328]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_075628__848.json62.5missing{\n "num_gpu": 99\n}missing
11968Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_075713__90200.043.76981[65, 233]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_075713__902.json62.5missing{\n "num_gpu": 99\n}missing
11969Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MInJulia1SHOTtruetrue620231227_093836__43900.064.29131[65, 391]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_093836__439.json62.5missing{\n "num_gpu": 99\n}missing
11970Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_075417__62100.060.21851[106, 321]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_075417__621.json62.5missing{\n "num_gpu": 99\n}missing
11971Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruefalse620231225_075528__67000.069.91390[106, 402]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_075528__670.json25.0missing{\n "num_gpu": 99\n}missing
11972Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_093731__25800.093.34680[106, 561]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_093731__258.json50.0missing{\n "num_gpu": 99\n}missing
11973Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620231225_075209__62200.080.53250[187, 273]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_075209__622.json25.0missing{\n "num_gpu": 99\n}missing
11974Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_075314__78000.064.19210[187, 363]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_075314__780.json50.0missing{\n "num_gpu": 99\n}missing
11975Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_093557__86400.058.44941[187, 187]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_093557__864.json62.5missing{\n "num_gpu": 99\n}missing
11976Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_080319__12500.086.0191[394, 444]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080319__125.json62.5missing{\n "num_gpu": 99\n}missing
11977Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_080438__66360.077.03062[394, 385]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080438__663.json100.0missing{\n "num_gpu": 99\n}missing
11978Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_094112__11130.055.56842[394, 279]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094112__111.json87.5missing{\n "num_gpu": 99\n}missing
11979Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTfalsefalse620231225_080054__59800.0102.0210[392, 545]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080054__598.json0.0missing{\n "num_gpu": 99\n}missing
11980Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_080151__17050.056.39852[392, 269]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080151__170.json95.8333missing{\n "num_gpu": 99\n}missing
11981Apple-MacBook-Pro-M1wrap_stringdeepseek-coder:33b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_094016__86500.0100.1440[392, 545]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/deepseek-coder:33b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094016__865.json50.0missing{\n "num_gpu": 99\n}missing
11982Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse620231227_094850__76300.012.29570[63, 475]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_094850__763.json0.0missing{\n "num_gpu": 99\n}missing
11983Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse620231227_133332__43100.08.179320[63, 319]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_133332__431.json0.0missing{\n "num_gpu": 99\n}missing
11984Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTtruetrue620231227_133340__64300.07.886260[63, 308]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_133340__643.json50.0missing{\n "num_gpu": 99\n}missing
11985Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KInJulia1SHOTfalsefalse620231227_133351__43700.010.92430[63, 424]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__InJulia__1SHOT__20231227_133351__437.json0.0missing{\n "num_gpu": 99\n}missing
11986Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTtruefalse620231227_094838__30500.09.044420[100, 344]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_094838__305.json25.0missing{\n "num_gpu": 99\n}missing
11987Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse620231227_133306__63300.08.494890[100, 323]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_133306__633.json0.0missing{\n "num_gpu": 99\n}missing
11988Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse620231227_133318__83200.012.40170[100, 470]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_133318__832.json0.0missing{\n "num_gpu": 99\n}missing
11989Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertAsk1SHOTfalsefalse620231227_133324__45200.05.327690[100, 200]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_133324__452.json0.0missing{\n "num_gpu": 99\n}missing
11990Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_094829__86700.07.469610[179, 142]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094829__867.json50.0missing{\n "num_gpu": 99\n}missing
11991Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231227_133237__97100.011.07590[179, 285]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133237__971.json0.0missing{\n "num_gpu": 99\n}missing
11992Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231227_133241__68000.04.424470[179, 154]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133241__680.json0.0missing{\n "num_gpu": 99\n}missing
11993Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_133257__78500.016.20880[179, 592]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133257__785.json50.0missing{\n "num_gpu": 99\n}missing
11994Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231227_094915__77200.012.91030[352, 437]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094915__772.json0.0missing{\n "num_gpu": 99\n}missing
11995Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_133424__86400.011.2840[352, 379]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133424__864.json50.0missing{\n "num_gpu": 99\n}missing
11996Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231227_133433__90200.08.92970[352, 295]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133433__902.json0.0missing{\n "num_gpu": 99\n}missing
11997Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_133444__70800.011.18930[352, 376]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_133444__708.json50.0missing{\n "num_gpu": 99\n}missing
11998Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue620231227_094902__87910.011.83570[349, 399]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_094902__879.json54.1667missing{\n "num_gpu": 99\n}missing
11999Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse620231227_133359__27100.08.036220[349, 262]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_133359__271.json0.0missing{\n "num_gpu": 99\n}missing
12000Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTfalsefalse620231227_133405__49800.06.151650[349, 192]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_133405__498.json0.0missing{\n "num_gpu": 99\n}missing
12001Apple-MacBook-Pro-M1wrap_stringdolphin-phi:2.7b-v2.6-q6_KJuliaRecapTask1SHOTtruetrue620231227_133413__60400.08.009940[349, 261]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/dolphin-phi:2.7b-v2.6-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_133413__604.json50.0missing{\n "num_gpu": 99\n}missing
12002Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestInJulia1SHOTfalsefalse620240217_113649__93700.09.622140[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_113649__937.json0.0missingmissingmissing
12003Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestInJulia1SHOTtruetrue620240217_113659__13900.09.494960[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_113659__139.json50.0missingmissingmissing
12004Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestInJulia1SHOTtruetrue620240217_113707__36610.07.85860[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_113707__366.json54.1667missingmissingmissing
12005Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestInJulia1SHOTtruetrue620240217_115002__88100.06.000580[242, 1216]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_115002__881.json50.0missingmissingmissing
12006Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestInJulia1SHOTtruetrue620240217_125528__66800.07.213010[242, 820]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__InJulia__1SHOT__20240217_125528__668.json50.0missingmissingmissing
12007Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue620240217_112642__72210.03.610430[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112642__722.json54.1667missingmissingmissing
12008Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse620240217_112650__41700.07.600620[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112650__417.json0.0missingmissingmissing
12009Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruefalse620240217_112653__76200.03.429960[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_112653__762.json25.0missingmissingmissing
12010Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertAsk1SHOTfalsefalse620240217_113744__90600.02.591430[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_113744__906.json0.0missingmissingmissing
12011Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertAsk1SHOTtruetrue620240217_113756__85930.011.52482[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertAsk__1SHOT__20240217_113756__859.json87.5missingmissingmissing
12012Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse620240217_112552__26100.02.503310[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112552__261.json25.0missingmissingmissing
12013Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse620240217_112556__34700.03.35410[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112556__347.json25.0missingmissingmissing
12014Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTfalsefalse620240217_112603__53700.06.844470[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112603__537.json0.0missingmissingmissing
12015Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruetrue620240217_112605__75400.02.012721[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112605__754.json62.5missingmissingmissing
12016Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaExpertCoTTask1SHOTtruefalse620240217_112607__95100.02.41060[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaExpertCoTTask__1SHOT__20240217_112607__951.json25.0missingmissingmissing
12017Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse620240217_112927__34800.02.853220[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112927__348.json25.0missingmissingmissing
12018Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse620240217_112937__69600.02.401120[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_112937__696.json25.0missingmissingmissing
12019Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTfalsefalse620240217_113733__25800.011.98460[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_113733__258.json0.0missingmissingmissing
12020Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruetrue620240217_113736__61300.03.360432[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_113736__613.json75.0missingmissingmissing
12021Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapCoTTask1SHOTtruefalse620240217_115005__85300.03.428690[1361, 489]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapCoTTask__1SHOT__20240217_115005__853.json25.0missingmissingmissing
12022Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse620240217_112841__53600.01.699680[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112841__536.json0.0missingmissingmissing
12023Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue620240217_112845__98250.04.526382[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112845__982.json95.8333missingmissingmissing
12024Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapTask1SHOTtruetrue620240217_112850__18300.04.526452[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_112850__183.json75.0missingmissingmissing
12025Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapTask1SHOTfalsefalse620240217_113801__87900.04.958720[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_113801__879.json0.0missingmissingmissing
12026Apple-MacBook-Pro-M1wrap_stringgemini-1.0-pro-latestJuliaRecapTask1SHOTtruefalse620240217_113806__84700.05.33020[0, 0]0.13.0-DEV21.1{}PromptingTools.GoogleSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemini-1.0-pro-latest/evaluation__JuliaRecapTask__1SHOT__20240217_113806__847.json25.0missingmissingmissing
12027Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse620240224_010200__12700.029.21570[0, 320]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_010200__127.json0.0missingmissingmissing
12028Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse620240224_010237__13100.036.40370[0, 399]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_010237__131.json0.0missingmissingmissing
12029Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse620240224_010309__13700.032.61130[0, 359]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_010309__137.json0.0missingmissingmissing
12030Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse620240224_010347__85500.038.03520[0, 419]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_010347__855.json0.0missingmissingmissing
12031Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KInJulia1SHOTfalsefalse620240224_010418__77000.031.29920[0, 347]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__InJulia__1SHOT__20240224_010418__770.json0.0missingmissingmissing
12032Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse620240224_005742__39200.031.71390[0, 339]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_005742__392.json0.0missingmissingmissing
12033Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse620240224_005807__11000.024.80760[0, 266]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_005807__110.json0.0missingmissingmissing
12034Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse620240224_005831__34000.023.30060[0, 250]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_005831__340.json0.0missingmissingmissing
12035Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse620240224_005856__11700.024.91560[0, 268]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_005856__117.json0.0missingmissingmissing
12036Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertAsk1SHOTfalsefalse620240224_005918__47200.022.0430[0, 238]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertAsk__1SHOT__20240224_005918__472.json0.0missingmissingmissing
12037Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse620240224_005247__34800.034.51070[0, 368]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_005247__348.json0.0missingmissingmissing
12038Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse620240224_005310__87700.023.40040[0, 250]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_005310__877.json0.0missingmissingmissing
12039Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse620240224_005343__20000.032.47520[0, 346]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_005343__200.json0.0missingmissingmissing
12040Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse620240224_005422__32100.039.52230[0, 421]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_005422__321.json0.0missingmissingmissing
12041Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaExpertCoTTask1SHOTfalsefalse620240224_005502__65500.039.47970[0, 420]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20240224_005502__655.json0.0missingmissingmissing
12042Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTtruefalse620240224_011355__78800.025.91010[0, 394]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_011355__788.json25.0missingmissingmissing
12043Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse620240224_011423__69000.028.19620[0, 390]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_011423__690.json0.0missingmissingmissing
12044Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse620240224_011451__69900.028.20030[0, 376]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_011451__699.json0.0missingmissingmissing
12045Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse620240224_011521__89600.030.13240[0, 435]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_011521__896.json0.0missingmissingmissing
12046Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapCoTTask1SHOTfalsefalse620240224_011551__30700.029.51510[0, 342]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20240224_011551__307.json0.0missingmissingmissing
12047Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse620240224_010804__34300.037.68580[0, 425]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_010804__343.json0.0missingmissingmissing
12048Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse620240224_010841__46100.036.86040[0, 416]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_010841__461.json0.0missingmissingmissing
12049Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse620240224_010919__30800.038.39680[0, 435]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_010919__308.json0.0missingmissingmissing
12050Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse620240224_010957__45800.038.08090[0, 428]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_010957__458.json0.0missingmissingmissing
12051Apple-MacBook-Pro-M1wrap_stringgemma:7b-instruct-q6_KJuliaRecapTask1SHOTfalsefalse620240224_011032__82800.034.59590[0, 388]0.13.0-DEV21.1{}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gemma:7b-instruct-q6_K/evaluation__JuliaRecapTask__1SHOT__20240224_011032__828.json0.0missingmissingmissing
12052Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboAsIs1SHOTtruetrue620231213_210245__20100.00049257.722030[55, 310]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231213_210245__201.json50.0missingmissingmissing
12053Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboAsIs1SHOTtruetrue620231225_231530__80950.00038753.652722[55, 240]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_231530__809.json95.8333missingmissingmissing
12054Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboAsIs1SHOTtruetrue620231225_231533__29520.000383.290232[55, 235]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231225_231533__295.json83.3333missingmissingmissing
12055Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo--optimAsIs1SHOTtruetrue620231215_202418__21820.06.762622[55, 278]0.10.0-DEV21.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__AsIs__1SHOT__20231215_202418__218.json83.33330.5missing0.5
12056Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboInJulia1SHOTtruetrue620231213_210237__44800.00043257.334141[58, 269]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231213_210237__448.json62.5missingmissingmissing
12057Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboInJulia1SHOTtruetrue620231225_231522__72920.00043253.753772[58, 269]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_231522__729.json83.3333missingmissingmissing
12058Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboInJulia1SHOTtruetrue620231225_231526__51430.0004374.277942[58, 272]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231225_231526__514.json87.5missingmissingmissing
12059Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboInJulia1SHOTtruetrue620231227_210826__90320.0004584.597742[58, 286]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_210826__903.json83.3333missingmissingmissing
12060Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboInJulia1SHOTtruetrue620231227_210831__57830.00047454.756482[58, 297]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231227_210831__578.json87.5missingmissingmissing
12061Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo--optimInJulia1SHOTtruetrue620231215_202411__86120.06.561342[58, 322]0.10.0-DEV21.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__InJulia__1SHOT__20231215_202411__861.json83.33330.5missing0.5
12062Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue620231213_210230__55900.00043955.879111[93, 262]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231213_210230__559.json62.5missingmissingmissing
12063Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue620231225_231515__77220.0003723.020882[93, 217]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_231515__772.json83.3333missingmissingmissing
12064Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue620231225_231518__99330.000272.489652[93, 149]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231225_231518__993.json87.5missingmissingmissing
12065Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue620231227_210817__88220.0002883.017552[93, 161]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_210817__882.json83.3333missingmissingmissing
12066Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertAsk1SHOTtruetrue620231227_210821__20750.0003964.145962[93, 233]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231227_210821__207.json95.8333missingmissingmissing
12067Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo--optimJuliaExpertAsk1SHOTtruetrue620231215_202404__26440.05.956092[93, 208]0.10.0-DEV21.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertAsk__1SHOT__20231215_202404__264.json91.66670.5missing0.5
12068Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse620231213_210224__26200.00033754.931060[162, 171]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210224__262.json0.0missingmissingmissing
12069Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse620231225_231510__69600.0002551.932630[162, 116]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231510__696.json0.0missingmissingmissing
12070Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertCoTTask1SHOTfalsefalse620231225_231512__48900.00027751.963160[162, 131]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231512__489.json0.0missingmissingmissing
12071Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue620231227_210807__23440.00043654.219132[162, 237]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210807__234.json91.6667missingmissingmissing
12072Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaExpertCoTTask1SHOTtruetrue620231227_210813__44530.0006156.228632[162, 356]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210813__445.json87.5missingmissingmissing
12073Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo--optimJuliaExpertCoTTask1SHOTtruetrue620231215_202358__64120.05.762282[162, 283]0.10.0-DEV21.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202358__641.json83.33330.5missing0.5
12074Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue620231213_210300__51220.0006918.271982[317, 355]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210300__512.json83.3333missingmissingmissing
12075Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue620231225_231543__83920.0006284.401172[317, 313]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231543__839.json83.3333missingmissingmissing
12076Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue620231225_231548__27020.0007064.792462[317, 365]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231548__270.json83.3333missingmissingmissing
12077Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapCoTTask1SHOTfalsefalse620231227_210847__96000.0003852.496890[317, 151]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210847__960.json0.0missingmissingmissing
12078Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapCoTTask1SHOTtruetrue620231227_210852__76020.0007185.724912[317, 373]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210852__760.json83.3333missingmissingmissing
12079Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo--optimJuliaRecapCoTTask1SHOTtruetrue620231215_202437__19820.07.969262[317, 349]0.10.0-DEV21.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202437__198.json83.33330.5missing0.5
12080Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapTask1SHOTtruetrue620231213_210252__35050.0005546.371242[316, 264]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231213_210252__350.json95.8333missingmissingmissing
12081Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse620231225_231537__93800.0004673.136120[316, 206]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_231537__938.json0.0missingmissingmissing
12082Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapTask1SHOTfalsefalse620231225_231538__99700.0003051.84850[316, 98]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231225_231538__997.json0.0missingmissingmissing
12083Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapTask1SHOTtruetrue620231227_210835__44420.0006444.77882[316, 324]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_210835__444.json83.3333missingmissingmissing
12084Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turboJuliaRecapTask1SHOTtruetrue620231227_210844__34540.00094558.36962[316, 525]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231227_210844__345.json91.6667missingmissingmissing
12085Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo--optimJuliaRecapTask1SHOTtruetrue620231215_202429__73620.010.98342[316, 487]0.10.0-DEV21.1{\n "temperature": 0.5,\n "top_p": 0.5\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo/evaluation__JuliaRecapTask__1SHOT__20231215_202429__736.json83.33330.5missing0.5
12086Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125InJulia1SHOTtruetrue620240201_200748__12320.0003952.009452[58, 244]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200748__123.json83.3333missingmissingmissing
12087Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125InJulia1SHOTtruetrue620240201_200750__73020.00036352.023342[58, 223]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200750__730.json83.3333missingmissingmissing
12088Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125InJulia1SHOTtruetrue620240201_200752__86500.000351.745141[58, 214]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200752__865.json62.5missingmissingmissing
12089Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125InJulia1SHOTtruetrue620240201_200754__37720.0003772.076932[58, 232]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200754__377.json83.3333missingmissingmissing
12090Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125InJulia1SHOTtruetrue620240201_200756__72240.00034551.719722[58, 211]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__InJulia__1SHOT__20240201_200756__722.json91.6667missingmissingmissing
12091Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue620240201_200741__61100.0002881.235961[93, 161]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200741__611.json62.5missingmissingmissing
12092Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue620240201_200743__34600.00027151.366231[93, 150]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200743__346.json62.5missingmissingmissing
12093Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue620240201_200744__65900.0002431.319181[93, 131]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200744__659.json62.5missingmissingmissing
12094Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue620240201_200745__74000.0002551.100231[93, 139]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200745__740.json62.5missingmissingmissing
12095Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertAsk1SHOTtruetrue620240201_200746__21900.00027751.166111[93, 154]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertAsk__1SHOT__20240201_200746__219.json62.5missingmissingmissing
12096Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue620240201_200733__11530.00043351.671932[162, 235]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200733__115.json87.5missingmissingmissing
12097Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue620240201_200735__38840.00047851.846672[162, 265]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200735__388.json91.6667missingmissingmissing
12098Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue620240201_200737__84920.00050852.195962[162, 285]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200737__849.json83.3333missingmissingmissing
12099Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue620240201_200739__86800.00043351.679281[162, 235]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200739__868.json62.5missingmissingmissing
12100Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaExpertCoTTask1SHOTtruetrue620240201_200740__61440.00028351.318982[162, 135]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaExpertCoTTask__1SHOT__20240201_200740__614.json91.6667missingmissingmissing
12101Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse620240201_200807__61300.0002830.7952540[317, 83]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200807__613.json0.0missingmissingmissing
12102Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse620240201_200807__70700.0002830.9734020[317, 83]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200807__707.json0.0missingmissingmissing
12103Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse620240201_200808__66800.0001990.4701040[317, 27]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200808__668.json0.0missingmissingmissing
12104Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse620240201_200809__55600.000310.9134330[317, 101]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200809__556.json0.0missingmissingmissing
12105Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapCoTTask1SHOTfalsefalse620240201_200810__22600.0003461.215360[317, 125]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapCoTTask__1SHOT__20240201_200810__226.json0.0missingmissingmissing
12106Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue620240201_200758__36750.0005212.234342[316, 242]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200758__367.json95.8333missingmissingmissing
12107Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue620240201_200801__72920.00053152.337542[316, 249]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200801__729.json83.3333missingmissingmissing
12108Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue620240201_200803__31400.00039351.975471[316, 157]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200803__314.json62.5missingmissingmissing
12109Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapTask1SHOTtruetrue620240201_200805__70800.0005151.921271[316, 238]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200805__708.json62.5missingmissingmissing
12110Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-0125JuliaRecapTask1SHOTfalsefalse620240201_200806__88900.0003230.9131920[316, 110]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-0125/evaluation__JuliaRecapTask__1SHOT__20240201_200806__889.json0.0missingmissingmissing
12111Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106AsIs1SHOTfalsefalse620231213_210317__79300.0005414.767230[55, 243]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231213_210317__793.json0.0missingmissingmissing
12112Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106AsIs1SHOTfalsefalse620231225_231602__75300.0004652.176470[55, 205]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_231602__753.json0.0missingmissingmissing
12113Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106AsIs1SHOTtruetrue620231225_231605__34620.0005032.678392[55, 224]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231225_231605__346.json83.3333missingmissingmissing
12114Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106--optimAsIs1SHOTfalsefalse620231215_202452__24800.03.486610[55, 192]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__AsIs__1SHOT__20231215_202452__248.json0.00.9missing0.1
12115Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106InJulia1SHOTtruetrue620231213_210312__64930.0005084.088652[58, 225]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231213_210312__649.json87.5missingmissingmissing
12116Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106InJulia1SHOTtruetrue620231225_231558__55740.0005042.572752[58, 223]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_231558__557.json91.6667missingmissingmissing
12117Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106InJulia1SHOTtruetrue620231225_231600__70220.0004942.420942[58, 218]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231225_231600__702.json83.3333missingmissingmissing
12118Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106InJulia1SHOTtruetrue620231227_210904__39320.0004842.908172[58, 213]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_210904__393.json83.3333missingmissingmissing
12119Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106InJulia1SHOTtruetrue620231227_210907__66720.0005162.93632[58, 229]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231227_210907__667.json83.3333missingmissingmissing
12120Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106--optimInJulia1SHOTtruetrue620231215_202448__62520.04.092322[58, 194]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__InJulia__1SHOT__20231215_202448__625.json83.33330.9missing0.1
12121Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue620231213_210308__88700.0003873.866261[93, 147]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231213_210308__887.json62.5missingmissingmissing
12122Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue620231225_231553__59500.0003431.676811[93, 125]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_231553__595.json62.5missingmissingmissing
12123Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue620231225_231555__57840.0003871.788592[93, 147]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231225_231555__578.json91.6667missingmissingmissing
12124Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue620231227_210858__63550.0003812.255962[93, 144]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_210858__635.json95.8333missingmissingmissing
12125Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertAsk1SHOTtruetrue620231227_210901__49340.0004172.356722[93, 162]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231227_210901__493.json91.6667missingmissingmissing
12126Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106--optimJuliaExpertAsk1SHOTtruetrue620231215_202444__25120.03.862212[93, 148]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertAsk__1SHOT__20231215_202444__251.json83.33330.9missing0.1
12127Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue620231213_210304__70320.0003983.748022[162, 118]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210304__703.json83.3333missingmissingmissing
12128Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue620231225_231549__69620.000411.596582[162, 124]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231549__696.json83.3333missingmissingmissing
12129Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue620231225_231551__22520.000381.423412[162, 109]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231551__225.json83.3333missingmissingmissing
12130Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue620231227_210854__41520.0003941.918872[162, 116]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210854__415.json83.3333missingmissingmissing
12131Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaExpertCoTTask1SHOTtruetrue620231227_210856__99420.0004041.656492[162, 121]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210856__994.json83.3333missingmissingmissing
12132Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106--optimJuliaExpertCoTTask1SHOTtruetrue620231215_202440__50620.03.054222[162, 116]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202440__506.json83.33330.9missing0.1
12133Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse620231213_210322__17100.0006893.626720[317, 186]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210322__171.json0.0missingmissingmissing
12134Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse620231225_231611__65900.0005331.601050[317, 108]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231611__659.json0.0missingmissingmissing
12135Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse620231225_231613__46400.0005011.20050[317, 92]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231613__464.json0.0missingmissingmissing
12136Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse620231227_210914__81800.0005391.628020[317, 111]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210914__818.json0.0missingmissingmissing
12137Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapCoTTask1SHOTfalsefalse620231227_210915__91800.0005191.598950[317, 101]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231227_210915__918.json0.0missingmissingmissing
12138Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106--optimJuliaRecapCoTTask1SHOTfalsefalse620231215_202456__61100.01.970270[317, 105]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202456__611.json0.00.9missing0.1
12139Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse620231213_210319__72100.0004661.368720[316, 75]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231213_210319__721.json0.0missingmissingmissing
12140Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse620231225_231607__71200.0005741.799950[316, 129]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_231607__712.json0.0missingmissingmissing
12141Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue620231225_231610__92600.000782.7630[316, 232]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231225_231610__926.json50.0missingmissingmissing
12142Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapTask1SHOTtruetrue620231227_210911__47520.0007363.389142[316, 210]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_210911__475.json83.3333missingmissingmissing
12143Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106JuliaRecapTask1SHOTfalsefalse620231227_210912__46800.0005441.603950[316, 114]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231227_210912__468.json0.0missingmissingmissing
12144Apple-MacBook-Pro-M1wrap_stringgpt-3.5-turbo-1106--optimJuliaRecapTask1SHOTfalsefalse620231215_202454__86900.02.160770[316, 139]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.1\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-3.5-turbo-1106/evaluation__JuliaRecapTask__1SHOT__20231215_202454__869.json0.00.9missing0.1
12145Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewInJulia1SHOTtruetrue620240201_120744__42600.0138727.76051[58, 443]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_120744__426.json62.5missingmissingmissing
12146Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewInJulia1SHOTtruetrue620240201_120817__74860.0153133.13682[58, 491]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_120817__748.json100.0missingmissingmissing
12147Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewInJulia1SHOTtruetrue620240201_120854__85360.0136336.51012[58, 435]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_120854__853.json100.0missingmissingmissing
12148Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewInJulia1SHOTtruetrue620240201_120930__83560.0158535.97192[58, 509]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_120930__835.json100.0missingmissingmissing
12149Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewInJulia1SHOTtruetrue620240201_121008__20550.0154338.15392[58, 495]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__InJulia__1SHOT__20240201_121008__205.json95.8333missingmissingmissing
12150Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue620240201_120326__13060.0077417.00652[93, 227]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_120326__130.json100.0missingmissingmissing
12151Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue620240201_120344__36300.0081318.0081[93, 240]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_120344__363.json62.5missingmissingmissing
12152Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue620240201_120358__26950.0072313.7472[93, 210]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_120358__269.json95.8333missingmissingmissing
12153Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue620240201_120411__26560.00612.65172[93, 169]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_120411__265.json100.0missingmissingmissing
12154Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertAsk1SHOTtruetrue620240201_120430__71850.0080118.95692[93, 236]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertAsk__1SHOT__20240201_120430__718.json95.8333missingmissingmissing
12155Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue620240201_115947__24160.0162934.05132[162, 489]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_115947__241.json100.0missingmissingmissing
12156Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue620240201_120005__69150.0094518.87022[162, 261]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_120005__691.json95.8333missingmissingmissing
12157Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue620240201_120037__42950.0127831.67942[162, 372]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_120037__429.json95.8333missingmissingmissing
12158Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue620240201_120119__18450.0130242.11212[162, 380]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_120119__184.json95.8333missingmissingmissing
12159Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaExpertCoTTask1SHOTtruetrue620240201_120150__53060.0140730.37992[162, 415]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaExpertCoTTask__1SHOT__20240201_120150__530.json100.0missingmissingmissing
12160Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue620240201_122008__95240.0152928.11012[317, 404]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_122008__952.json91.6667missingmissingmissing
12161Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue620240201_122037__25350.0176329.69122[317, 482]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_122037__253.json95.8333missingmissingmissing
12162Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue620240201_122150__25560.0190472.16512[317, 529]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_122150__255.json100.0missingmissingmissing
12163Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue620240201_122229__70260.0213238.87162[317, 605]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_122229__702.json100.0missingmissingmissing
12164Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapCoTTask1SHOTtruetrue620240201_122249__79960.0128920.52162[317, 324]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapCoTTask__1SHOT__20240201_122249__799.json100.0missingmissingmissing
12165Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue620240201_121355__24850.0174132.34372[316, 475]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_121355__248.json95.8333missingmissingmissing
12166Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue620240201_121437__63550.0199641.84332[316, 560]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_121437__635.json95.8333missingmissingmissing
12167Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue620240201_121522__47260.0170544.91772[316, 463]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_121522__472.json100.0missingmissingmissing
12168Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue620240201_121541__73400.0157318.93191[316, 419]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_121541__734.json62.5missingmissingmissing
12169Apple-MacBook-Pro-M1wrap_stringgpt-4-0125-previewJuliaRecapTask1SHOTtruetrue620240201_121618__55960.0188237.24782[316, 522]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-0125-preview/evaluation__JuliaRecapTask__1SHOT__20240201_121618__559.json100.0missingmissingmissing
12170Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewAsIs1SHOTfalsefalse620231213_210528__50600.0115632.18310[55, 367]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231213_210528__506.json0.0missingmissingmissing
12171Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewAsIs1SHOTfalsefalse620231225_231753__66300.013315.16610[55, 425]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_231753__663.json0.0missingmissingmissing
12172Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewAsIs1SHOTfalsefalse620231225_231810__50200.0135116.61190[55, 432]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231225_231810__502.json0.0missingmissingmissing
12173Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-preview--optimAsIs1SHOTfalsefalse620231215_202714__22600.034.40460[55, 393]0.10.0-DEV21.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__AsIs__1SHOT__20231215_202714__226.json0.00.1missing0.9
12174Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewInJulia1SHOTtruetrue620231213_210455__75460.012727.48192[58, 404]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231213_210455__754.json100.0missingmissingmissing
12175Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewInJulia1SHOTtruetrue620231225_231718__58650.0127313.64352[58, 405]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_231718__586.json95.8333missingmissingmissing
12176Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewInJulia1SHOTtruetrue620231225_231738__77260.0159420.12282[58, 512]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231225_231738__772.json100.0missingmissingmissing
12177Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewInJulia1SHOTtruetrue620231227_211106__89760.0155529.83132[58, 499]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_211106__897.json100.0missingmissingmissing
12178Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewInJulia1SHOTtruetrue620231227_211149__95660.0135742.18562[58, 433]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231227_211149__956.json100.0missingmissingmissing
12179Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-preview--optimInJulia1SHOTtruetrue620231215_202640__49450.048.73962[58, 380]0.10.0-DEV21.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__InJulia__1SHOT__20231215_202640__494.json95.83330.1missing0.9
12180Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue620231213_210428__92060.0069914.77932[93, 202]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231213_210428__920.json100.0missingmissingmissing
12181Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue620231225_231655__49460.008799.873112[93, 262]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_231655__494.json100.0missingmissingmissing
12182Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue620231225_231704__73250.008678.684282[93, 258]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231225_231704__732.json95.8333missingmissingmissing
12183Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue620231227_211025__28250.0070514.7022[93, 204]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_211025__282.json95.8333missingmissingmissing
12184Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertAsk1SHOTtruetrue620231227_211036__57340.0068411.43112[93, 197]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231227_211036__573.json91.6667missingmissingmissing
12185Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-preview--optimJuliaExpertAsk1SHOTtruetrue620231215_202551__69560.023.13222[93, 178]0.10.0-DEV21.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertAsk__1SHOT__20231215_202551__695.json100.00.1missing0.9
12186Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue620231213_210413__72850.0136850.62332[162, 402]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210413__728.json95.8333missingmissingmissing
12187Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue620231225_231627__46160.0154513.98782[162, 461]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231627__461.json100.0missingmissingmissing
12188Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue620231225_231645__18760.0116718.02912[162, 335]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231645__187.json100.0missingmissingmissing
12189Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue620231227_210937__60550.0133821.44522[162, 392]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_210937__605.json95.8333missingmissingmissing
12190Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaExpertCoTTask1SHOTtruetrue620231227_211010__47050.0145532.84822[162, 431]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211010__470.json95.8333missingmissingmissing
12191Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-preview--optimJuliaExpertCoTTask1SHOTtruetrue620231215_202528__20020.031.34682[162, 340]0.10.0-DEV21.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202528__200.json83.33330.1missing0.9
12192Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue620231213_210638__85250.0124122.0342[317, 308]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210638__852.json95.8333missingmissingmissing
12193Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue620231225_231930__52260.0136116.24632[317, 348]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231930__522.json100.0missingmissingmissing
12194Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue620231225_231944__77350.0153813.19112[317, 407]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231225_231944__773.json95.8333missingmissingmissing
12195Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue620231227_211255__69940.0141232.13042[317, 365]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211255__699.json91.6667missingmissingmissing
12196Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapCoTTask1SHOTtruetrue620231227_211325__90860.014929.85932[317, 391]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211325__908.json100.0missingmissingmissing
12197Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-preview--optimJuliaRecapCoTTask1SHOTtruetrue620231215_202811__33750.026.5292[317, 331]0.10.0-DEV21.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202811__337.json95.83330.1missing0.9
12198Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue620231213_210616__26660.0158548.27132[316, 423]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231213_210616__266.json100.0missingmissingmissing
12199Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue620231225_231853__36560.024443.02682[316, 708]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_231853__365.json100.0missingmissingmissing
12200Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue620231225_231914__50060.018420.72242[316, 508]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231225_231914__500.json100.0missingmissingmissing
12201Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue620231227_211207__33560.0107518.28472[316, 253]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_211207__335.json100.0missingmissingmissing
12202Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-previewJuliaRecapTask1SHOTtruetrue620231227_211223__51350.0106615.90722[316, 250]0.10.0-DEV21.1{}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231227_211223__513.json95.8333missingmissingmissing
12203Apple-MacBook-Pro-M1wrap_stringgpt-4-1106-preview--optimJuliaRecapTask1SHOTtruetrue620231215_202744__59040.030.0962[316, 400]0.10.0-DEV21.1{\n "temperature": 0.1,\n "top_p": 0.9\n}PromptingTools.OpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/gpt-4-1106-preview/evaluation__JuliaRecapTask__1SHOT__20231215_202744__590.json91.66670.1missing0.9
12204Apple-MacBook-Pro-M1wrap_stringllama2AsIs1SHOTfalsefalse620231214_090018__87000.015.36910[48, 461]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__AsIs__1SHOT__20231214_090018__870.json0.0missingmissingmissing
12205Apple-MacBook-Pro-M1wrap_stringllama2AsIs1SHOTfalsefalse620231225_071244__70900.011.00510[48, 331]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__AsIs__1SHOT__20231225_071244__709.json0.0missing{\n "num_gpu": 99\n}missing
12206Apple-MacBook-Pro-M1wrap_stringllama2AsIs1SHOTfalsefalse620231225_071256__82500.011.71510[1, 363]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__AsIs__1SHOT__20231225_071256__825.json0.0missing{\n "num_gpu": 99\n}missing
12207Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTtruefalse620231214_090003__84100.015.52050[65, 461]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231214_090003__841.json25.0missingmissingmissing
12208Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTtruefalse620231225_071219__52300.013.3290[65, 394]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231225_071219__523.json25.0missing{\n "num_gpu": 99\n}missing
12209Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTfalsefalse620231225_071233__48500.013.77040[1, 422]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231225_071233__485.json0.0missing{\n "num_gpu": 99\n}missing
12210Apple-MacBook-Pro-M1wrap_stringllama2InJulia1SHOTtruetrue620231227_092002__78000.012.50240[65, 380]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__InJulia__1SHOT__20231227_092002__780.json50.0missing{\n "num_gpu": 99\n}missing
12211Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTtruetrue620231214_085947__42600.08.250632[94, 241]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231214_085947__426.json75.0missingmissingmissing
12212Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTfalsefalse620231225_071158__80000.09.657990[94, 280]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_071158__800.json0.0missing{\n "num_gpu": 99\n}missing
12213Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTtruetrue620231225_071206__29200.07.502020[1, 234]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231225_071206__292.json50.0missing{\n "num_gpu": 99\n}missing
12214Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertAsk1SHOTfalsefalse620231227_091950__99700.012.97280[94, 386]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertAsk__1SHOT__20231227_091950__997.json0.0missing{\n "num_gpu": 99\n}missing
12215Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTfalsefalse620231214_085939__13400.015.06280[175, 408]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_085939__134.json0.0missingmissingmissing
12216Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruetrue620231225_071127__60900.024.42180[193, 420]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071127__609.json50.0missing{\n "num_gpu": 99\n}missing
12217Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruetrue620231225_071148__17500.019.16730[1, 548]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071148__175.json50.0missing{\n "num_gpu": 99\n}missing
12218Apple-MacBook-Pro-M1wrap_stringllama2JuliaExpertCoTTask1SHOTtruetrue620231227_091936__90400.022.5990[193, 441]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_091936__904.json50.0missing{\n "num_gpu": 99\n}missing
12219Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTtruetrue620231214_090108__41800.027.09220[11, 718]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090108__418.json50.0missingmissingmissing
12220Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTfalsefalse620231225_071354__77600.020.42520[11, 549]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071354__776.json0.0missing{\n "num_gpu": 99\n}missing
12221Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTfalsefalse620231225_071414__24300.019.92760[1, 542]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071414__243.json0.0missing{\n "num_gpu": 99\n}missing
12222Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapCoTTask1SHOTfalsefalse620231227_092032__99400.02.413510[11, 66]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092032__994.json0.0missing{\n "num_gpu": 99\n}missing
12223Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTfalsefalse620231214_090041__68200.023.2560[365, 548]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231214_090041__682.json0.0missingmissingmissing
12224Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTfalsefalse620231225_071311__27400.015.33460[365, 337]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_071311__274.json0.0missing{\n "num_gpu": 99\n}missing
12225Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTfalsefalse620231225_071334__65800.022.44620[1, 605]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231225_071334__658.json0.0missing{\n "num_gpu": 99\n}missing
12226Apple-MacBook-Pro-M1wrap_stringllama2JuliaRecapTask1SHOTtruetrue620231227_092030__85020.027.64932[365, 666]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/llama2/evaluation__JuliaRecapTask__1SHOT__20231227_092030__850.json83.3333missing{\n "num_gpu": 99\n}missing
12227Apple-MacBook-Pro-M1wrap_stringmagicoderAsIs1SHOTfalsefalse620231214_090958__35600.016.94080[48, 505]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__AsIs__1SHOT__20231214_090958__356.json0.0missingmissingmissing
12228Apple-MacBook-Pro-M1wrap_stringmagicoderAsIs1SHOTfalsefalse620231225_073608__90300.05.166320[62, 164]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__AsIs__1SHOT__20231225_073608__903.json0.0missing{\n "num_gpu": 99\n}missing
12229Apple-MacBook-Pro-M1wrap_stringmagicoderAsIs1SHOTfalsefalse620231225_073614__49500.06.119210[62, 197]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__AsIs__1SHOT__20231225_073614__495.json0.0missing{\n "num_gpu": 99\n}missing
12230Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231214_090941__54100.017.35662[65, 512]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231214_090941__541.json75.0missingmissingmissing
12231Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231225_073555__33800.09.560991[65, 304]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231225_073555__338.json62.5missing{\n "num_gpu": 99\n}missing
12232Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231225_073603__92600.07.140851[65, 225]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231225_073603__926.json62.5missing{\n "num_gpu": 99\n}missing
12233Apple-MacBook-Pro-M1wrap_stringmagicoderInJulia1SHOTtruetrue620231227_092826__31230.012.3582[65, 406]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__InJulia__1SHOT__20231227_092826__312.json87.5missing{\n "num_gpu": 99\n}missing
12234Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTfalsefalse620231214_090923__97900.09.881330[94, 290]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231214_090923__979.json0.0missingmissingmissing
12235Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruetrue620231225_073535__60600.07.821671[104, 243]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_073535__606.json62.5missing{\n "num_gpu": 99\n}missing
12236Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruetrue620231225_073545__99900.010.00750[104, 315]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231225_073545__999.json50.0missing{\n "num_gpu": 99\n}missing
12237Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertAsk1SHOTtruetrue620231227_092814__98600.09.810630[104, 315]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertAsk__1SHOT__20231227_092814__986.json50.0missing{\n "num_gpu": 99\n}missing
12238Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTfalsefalse620231214_090913__63500.020.41570[175, 555]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090913__635.json0.0missingmissingmissing
12239Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTtruetrue620231225_073518__76600.016.00271[185, 289]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073518__766.json62.5missing{\n "num_gpu": 99\n}missing
12240Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTtruetrue620231225_073527__93610.09.4752[185, 283]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073527__936.json79.1667missing{\n "num_gpu": 99\n}missing
12241Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaExpertCoTTask1SHOTtruetrue620231227_092804__44060.015.48522[185, 299]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092804__440.json100.0missing{\n "num_gpu": 99\n}missing
12242Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTfalsefalse620231214_091039__11300.020.70420[11, 560]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091039__113.json0.0missingmissingmissing
12243Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTtruetrue620231225_073650__98400.013.22261[368, 368]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073650__984.json62.5missing{\n "num_gpu": 99\n}missing
12244Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTtruetrue620231225_073701__63240.010.88742[368, 299]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073701__632.json91.6667missing{\n "num_gpu": 99\n}missing
12245Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapCoTTask1SHOTtruetrue620231227_092850__88640.010.85542[368, 301]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092850__886.json91.6667missing{\n "num_gpu": 99\n}missing
12246Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTfalsefalse620231214_091018__84500.020.30920[365, 472]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231214_091018__845.json0.0missingmissingmissing
12247Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTtruetrue620231225_073627__13200.013.00861[365, 362]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_073627__132.json62.5missing{\n "num_gpu": 99\n}missing
12248Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTtruetrue620231225_073636__92230.08.962522[365, 236]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231225_073636__922.json87.5missing{\n "num_gpu": 99\n}missing
12249Apple-MacBook-Pro-M1wrap_stringmagicoderJuliaRecapTask1SHOTtruetrue620231227_092839__65200.012.97490[365, 368]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder/evaluation__JuliaRecapTask__1SHOT__20231227_092839__652.json50.0missing{\n "num_gpu": 99\n}missing
12250Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue620231227_183434__41200.016.0371[65, 311]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183434__412.json62.5missing{\n "num_gpu": 99\n}missing
12251Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue620231227_183454__85800.020.47491[65, 398]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183454__858.json62.5missing{\n "num_gpu": 99\n}missing
12252Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KInJulia1SHOTtruetrue620231227_183511__14040.016.15472[65, 313]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__InJulia__1SHOT__20231227_183511__140.json91.6667missing{\n "num_gpu": 99\n}missing
12253Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue620231227_183349__81100.011.12040[104, 209]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183349__811.json50.0missing{\n "num_gpu": 99\n}missing
12254Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue620231227_183403__11560.014.04222[104, 267]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183403__115.json100.0missing{\n "num_gpu": 99\n}missing
12255Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertAsk1SHOTtruetrue620231227_183418__39360.014.69782[104, 280]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_183418__393.json100.0missing{\n "num_gpu": 99\n}missing
12256Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_183310__96830.013.95982[185, 257]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_183310__968.json87.5missing{\n "num_gpu": 99\n}missing
12257Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_183321__21130.010.77312[185, 194]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_183321__211.json87.5missing{\n "num_gpu": 99\n}missing
12258Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaExpertCoTTask1SHOTtruetrue620231227_183337__32730.016.42862[185, 305]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_183337__327.json87.5missing{\n "num_gpu": 99\n}missing
12259Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_183624__57630.021.65352[368, 380]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183624__576.json87.5missing{\n "num_gpu": 99\n}missing
12260Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_183640__24340.016.81152[368, 288]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183640__243.json91.6667missing{\n "num_gpu": 99\n}missing
12261Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_183659__96740.018.28682[368, 316]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_183659__967.json91.6667missing{\n "num_gpu": 99\n}missing
12262Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue620231227_183532__40420.021.03042[365, 368]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183532__404.json83.3333missing{\n "num_gpu": 99\n}missing
12263Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue620231227_183551__21340.018.70412[365, 324]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183551__213.json91.6667missing{\n "num_gpu": 99\n}missing
12264Apple-MacBook-Pro-M1wrap_stringmagicoder:7b-s-cl-q6_KJuliaRecapTask1SHOTtruetrue620231227_183602__99500.011.03792[365, 177]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/magicoder:7b-s-cl-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_183602__995.json75.0missing{\n "num_gpu": 99\n}missing
12265Apple-MacBook-Pro-M1wrap_stringmistral-mediumAsIs1SHOTfalsefalse620231213_210950__51500.0028397928.97150[60, 331]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__AsIs__1SHOT__20231213_210950__515.json0.0missingmissingmissing
12266Apple-MacBook-Pro-M1wrap_stringmistral-mediumAsIs1SHOTfalsefalse620231225_232250__85700.00299357.75960[60, 350]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__AsIs__1SHOT__20231225_232250__857.json0.0missingmissingmissing
12267Apple-MacBook-Pro-M1wrap_stringmistral-mediumAsIs1SHOTfalsefalse620231225_232259__90300.003689249.615090[60, 436]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__AsIs__1SHOT__20231225_232259__903.json0.0missingmissingmissing
12268Apple-MacBook-Pro-M1wrap_stringmistral-medium--optimAsIs1SHOTfalsefalse620231215_202937__87700.08.323590[60, 378]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__AsIs__1SHOT__20231215_202937__877.json0.00.9missing0.3
12269Apple-MacBook-Pro-M1wrap_stringmistral-mediumInJulia1SHOTtruetrue620231213_210921__56730.0033980134.68862[63, 399]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__InJulia__1SHOT__20231213_210921__567.json87.5missingmissingmissing
12270Apple-MacBook-Pro-M1wrap_stringmistral-mediumInJulia1SHOTtruetrue620231225_232228__30730.002928797.592542[63, 341]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__InJulia__1SHOT__20231225_232228__307.json87.5missingmissingmissing
12271Apple-MacBook-Pro-M1wrap_stringmistral-mediumInJulia1SHOTtruetrue620231225_232242__16050.0035112713.85112[63, 413]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__InJulia__1SHOT__20231225_232242__160.json95.8333missingmissingmissing
12272Apple-MacBook-Pro-M1wrap_stringmistral-mediumInJulia1SHOTtruetrue620231227_211638__77650.0050645522.63262[63, 605]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__InJulia__1SHOT__20231227_211638__776.json95.8333missingmissingmissing
12273Apple-MacBook-Pro-M1wrap_stringmistral-mediumInJulia1SHOTtruetrue620231227_211656__80730.003406117.60232[63, 400]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__InJulia__1SHOT__20231227_211656__807.json87.5missingmissingmissing
12274Apple-MacBook-Pro-M1wrap_stringmistral-medium--optimInJulia1SHOTtruetrue620231215_202928__18530.06.611312[63, 302]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__InJulia__1SHOT__20231215_202928__185.json87.50.9missing0.3
12275Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertAsk1SHOTtruetrue620231213_210846__64060.0033172434.39472[102, 376]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231213_210846__640.json100.0missingmissingmissing
12276Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertAsk1SHOTtruetrue620231225_232210__93240.002338355.683492[102, 255]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_232210__932.json91.6667missingmissingmissing
12277Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertAsk1SHOTtruetrue620231225_232220__55150.003737929.521212[102, 428]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231225_232220__551.json95.8333missingmissingmissing
12278Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertAsk1SHOTtruefalse620231227_211546__97900.0027913920.68490[102, 311]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_211546__979.json25.0missingmissingmissing
12279Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertAsk1SHOTtruetrue620231227_211615__43530.0030340928.9442[102, 341]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231227_211615__435.json87.5missingmissingmissing
12280Apple-MacBook-Pro-M1wrap_stringmistral-medium--optimJuliaExpertAsk1SHOTtruetrue620231215_202922__39330.07.470582[102, 337]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertAsk__1SHOT__20231215_202922__393.json87.50.9missing0.3
12281Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertCoTTask1SHOTtruetrue620231213_210811__86800.0043368512.50831[183, 475]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210811__868.json62.5missingmissingmissing
12282Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertCoTTask1SHOTtruetrue620231225_232155__85300.0050487712.56671[183, 563]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_232155__853.json62.5missingmissingmissing
12283Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertCoTTask1SHOTtruetrue620231225_232204__17130.003689658.859712[183, 395]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231225_232204__171.json87.5missingmissingmissing
12284Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertCoTTask1SHOTtruetrue620231227_211506__48740.003770559.12332[183, 405]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211506__487.json91.6667missingmissingmissing
12285Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaExpertCoTTask1SHOTtruetrue620231227_211525__38140.0045714618.83422[183, 504]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211525__381.json91.6667missingmissingmissing
12286Apple-MacBook-Pro-M1wrap_stringmistral-medium--optimJuliaExpertCoTTask1SHOTtruetrue620231215_202914__80340.010.33992[183, 465]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202914__803.json91.66670.9missing0.3
12287Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapCoTTask1SHOTtruetrue620231213_211102__80500.0045855542.92411[365, 445]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231213_211102__805.json62.5missingmissingmissing
12288Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapCoTTask1SHOTtruetrue620231225_232329__46430.0045531910.48692[365, 441]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_232329__464.json87.5missingmissingmissing
12289Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapCoTTask1SHOTtruetrue620231225_232357__22900.0038898127.6611[365, 359]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231225_232357__229.json62.5missingmissingmissing
12290Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapCoTTask1SHOTtruetrue620231227_211746__45430.0044075721.26182[365, 423]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211746__454.json87.5missingmissingmissing
12291Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapCoTTask1SHOTtruetrue620231227_211801__76350.0034529515.04912[365, 305]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211801__763.json95.8333missingmissingmissing
12292Apple-MacBook-Pro-M1wrap_stringmistral-medium--optimJuliaRecapCoTTask1SHOTtruetrue620231215_202958__52460.010.72492[365, 400]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202958__524.json100.00.9missing0.3
12293Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapTask1SHOTtruetrue620231213_211019__62510.0035742929.24862[362, 321]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231213_211019__625.json79.1667missingmissingmissing
12294Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapTask1SHOTtruetrue620231225_232309__17350.004261949.16882[362, 406]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_232309__173.json95.8333missingmissingmissing
12295Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapTask1SHOTtruetrue620231225_232318__61450.004407569.624772[362, 424]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231225_232318__614.json95.8333missingmissingmissing
12296Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapTask1SHOTtruetrue620231227_211707__16960.0048201510.90422[362, 475]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_211707__169.json100.0missingmissingmissing
12297Apple-MacBook-Pro-M1wrap_stringmistral-mediumJuliaRecapTask1SHOTtruetrue620231227_211724__11160.0048767817.48682[362, 482]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231227_211724__111.json100.0missingmissingmissing
12298Apple-MacBook-Pro-M1wrap_stringmistral-medium--optimJuliaRecapTask1SHOTtruetrue620231215_202947__69530.010.0182[362, 445]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-medium/evaluation__JuliaRecapTask__1SHOT__20231215_202947__695.json87.50.9missing0.3
12299Apple-MacBook-Pro-M1wrap_stringmistral-smallAsIs1SHOTtruetrue620231213_210746__60330.0007967135.387242[59, 391]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__AsIs__1SHOT__20231213_210746__603.json87.5missingmissingmissing
12300Apple-MacBook-Pro-M1wrap_stringmistral-smallAsIs1SHOTtruetrue620231225_232103__49030.0007714935.102882[59, 378]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__AsIs__1SHOT__20231225_232103__490.json87.5missingmissingmissing
12301Apple-MacBook-Pro-M1wrap_stringmistral-smallAsIs1SHOTtruetrue620231225_232120__48830.00077925317.31122[59, 382]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__AsIs__1SHOT__20231225_232120__488.json87.5missingmissingmissing
12302Apple-MacBook-Pro-M1wrap_stringmistral-small--optimAsIs1SHOTtruetrue620231215_202852__52610.06.62852[59, 500]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__AsIs__1SHOT__20231215_202852__526.json79.16670.9missing0.3
12303Apple-MacBook-Pro-M1wrap_stringmistral-smallInJulia1SHOTtruetrue620231213_210741__22530.0007559745.041422[62, 369]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__InJulia__1SHOT__20231213_210741__225.json87.5missingmissingmissing
12304Apple-MacBook-Pro-M1wrap_stringmistral-smallInJulia1SHOTtruetrue620231225_232052__17210.0009945946.640210[62, 492]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__InJulia__1SHOT__20231225_232052__172.json54.1667missingmissingmissing
12305Apple-MacBook-Pro-M1wrap_stringmistral-smallInJulia1SHOTtruetrue620231225_232057__93020.0008393945.645892[62, 412]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__InJulia__1SHOT__20231225_232057__930.json83.3333missingmissingmissing
12306Apple-MacBook-Pro-M1wrap_stringmistral-smallInJulia1SHOTtruetrue620231227_211433__14350.0006919544.469762[62, 336]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__InJulia__1SHOT__20231227_211433__143.json95.8333missingmissingmissing
12307Apple-MacBook-Pro-M1wrap_stringmistral-smallInJulia1SHOTtruetrue620231227_211438__62030.0007811945.136842[62, 382]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__InJulia__1SHOT__20231227_211438__620.json87.5missingmissingmissing
12308Apple-MacBook-Pro-M1wrap_stringmistral-small--optimInJulia1SHOTtruetrue620231215_202845__71930.04.885762[62, 373]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__InJulia__1SHOT__20231215_202845__719.json87.50.9missing0.3
12309Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertAsk1SHOTtruetrue620231213_210735__94230.0006544614.154322[103, 303]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231213_210735__942.json87.5missingmissingmissing
12310Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertAsk1SHOTtruetrue620231225_232041__80800.0005768613.584692[103, 263]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_232041__808.json75.0missingmissingmissing
12311Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertAsk1SHOTtruetrue620231225_232045__21010.0005923813.674872[103, 271]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231225_232045__210.json79.1667missingmissingmissing
12312Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertAsk1SHOTtruetrue620231227_211425__64410.0004953813.028692[103, 221]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_211425__644.json79.1667missingmissingmissing
12313Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertAsk1SHOTtruetrue620231227_211428__99800.0005089613.179872[103, 228]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231227_211428__998.json75.0missingmissingmissing
12314Apple-MacBook-Pro-M1wrap_stringmistral-small--optimJuliaExpertAsk1SHOTtruetrue620231215_202840__58100.03.078522[103, 228]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertAsk__1SHOT__20231215_202840__581.json75.00.9missing0.3
12315Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertCoTTask1SHOTtruetrue620231213_210731__14330.0008581885.18982[184, 381]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210731__143.json87.5missingmissingmissing
12316Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertCoTTask1SHOTtruetrue620231225_232030__31230.0008834085.375522[184, 394]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_232030__312.json87.5missingmissingmissing
12317Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertCoTTask1SHOTtruetrue620231225_232037__20710.001110397.296410[184, 511]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231225_232037__207.json54.1667missingmissingmissing
12318Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertCoTTask1SHOTtruetrue620231227_211417__73400.001137557.077260[184, 525]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211417__734.json50.0missingmissingmissing
12319Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaExpertCoTTask1SHOTtruetrue620231227_211422__62940.0007767084.612062[184, 339]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211422__629.json91.6667missingmissingmissing
12320Apple-MacBook-Pro-M1wrap_stringmistral-small--optimJuliaExpertCoTTask1SHOTtruetrue620231215_202837__34040.05.421612[184, 413]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202837__340.json91.66670.9missing0.3
12321Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapCoTTask1SHOTtruetrue620231213_210759__46000.001084586.032510[369, 436]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210759__460.json50.0missingmissingmissing
12322Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapCoTTask1SHOTtruetrue620231225_232141__66700.0009080434.761850[369, 345]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_232141__667.json50.0missingmissingmissing
12323Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapCoTTask1SHOTfalsefalse620231225_232143__45400.0004443831.556280[369, 106]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231225_232143__454.json0.0missingmissingmissing
12324Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapCoTTask1SHOTtruetrue620231227_211452__27740.001189346.665552[369, 490]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211452__277.json91.6667missingmissingmissing
12325Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapCoTTask1SHOTtruetrue620231227_211457__69640.0009720635.086952[369, 378]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211457__696.json91.6667missingmissingmissing
12326Apple-MacBook-Pro-M1wrap_stringmistral-small--optimJuliaRecapCoTTask1SHOTtruetrue620231215_202904__39050.06.96532[369, 521]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202904__390.json95.83330.9missing0.3
12327Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapTask1SHOTtruetrue620231213_210753__62400.001104636.270910[367, 447]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231213_210753__624.json50.0missingmissingmissing
12328Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapTask1SHOTtruetrue620231225_232127__33100.001213276.875920[367, 503]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_232127__331.json50.0missingmissingmissing
12329Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapTask1SHOTtruetrue620231225_232136__77510.001494578.819710[367, 648]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231225_232136__775.json54.1667missingmissingmissing
12330Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapTask1SHOTfalsefalse620231227_211439__22700.0003363890.8765880[367, 51]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_211439__227.json0.0missingmissingmissing
12331Apple-MacBook-Pro-M1wrap_stringmistral-smallJuliaRecapTask1SHOTtruetrue620231227_211445__79330.001052255.735972[367, 420]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231227_211445__793.json87.5missingmissingmissing
12332Apple-MacBook-Pro-M1wrap_stringmistral-small--optimJuliaRecapTask1SHOTtruetrue620231215_202857__18500.04.61720[367, 340]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-small/evaluation__JuliaRecapTask__1SHOT__20231215_202857__185.json50.00.9missing0.3
12333Apple-MacBook-Pro-M1wrap_stringmistral-tinyAsIs1SHOTfalsefalse620231213_210708__69000.0001495965.764370[59, 312]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__AsIs__1SHOT__20231213_210708__690.json0.0missingmissingmissing
12334Apple-MacBook-Pro-M1wrap_stringmistral-tinyAsIs1SHOTfalsefalse620231225_232008__34400.0001319293.081230[59, 273]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__AsIs__1SHOT__20231225_232008__344.json0.0missingmissingmissing
12335Apple-MacBook-Pro-M1wrap_stringmistral-tinyAsIs1SHOTfalsefalse620231225_232010__55200.0001332882.425440[59, 276]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__AsIs__1SHOT__20231225_232010__552.json0.0missingmissingmissing
12336Apple-MacBook-Pro-M1wrap_stringmistral-tiny--optimAsIs1SHOTfalsefalse620231215_202824__66100.02.893390[59, 332]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__AsIs__1SHOT__20231215_202824__661.json0.00.9missing0.3
12337Apple-MacBook-Pro-M1wrap_stringmistral-tinyInJulia1SHOTtruefalse620231213_210702__67400.0001549995.502450[62, 323]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__InJulia__1SHOT__20231213_210702__674.json25.0missingmissingmissing
12338Apple-MacBook-Pro-M1wrap_stringmistral-tinyInJulia1SHOTtruetrue620231225_232001__39830.0001527342.853682[62, 318]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__InJulia__1SHOT__20231225_232001__398.json87.5missingmissingmissing
12339Apple-MacBook-Pro-M1wrap_stringmistral-tinyInJulia1SHOTtruefalse620231225_232004__58500.000158172.90990[62, 330]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__InJulia__1SHOT__20231225_232004__585.json25.0missingmissingmissing
12340Apple-MacBook-Pro-M1wrap_stringmistral-tinyInJulia1SHOTfalsefalse620231227_211348__55100.000212533.920170[62, 450]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__InJulia__1SHOT__20231227_211348__551.json0.0missingmissingmissing
12341Apple-MacBook-Pro-M1wrap_stringmistral-tinyInJulia1SHOTfalsefalse620231227_211351__55600.0001513752.828940[62, 315]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__InJulia__1SHOT__20231227_211351__556.json0.0missingmissingmissing
12342Apple-MacBook-Pro-M1wrap_stringmistral-tiny--optimInJulia1SHOTtruetrue620231215_202821__15000.02.981292[62, 343]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__InJulia__1SHOT__20231215_202821__150.json75.00.9missing0.3
12343Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertAsk1SHOTtruefalse620231213_210657__83400.0001113624.031440[103, 214]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231213_210657__834.json25.0missingmissingmissing
12344Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertAsk1SHOTtruetrue620231225_231956__12200.0001041141.733291[103, 198]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_231956__122.json62.5missingmissingmissing
12345Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertAsk1SHOTtruetrue620231225_231958__10700.0001063791.839671[103, 203]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231225_231958__107.json62.5missingmissingmissing
12346Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertAsk1SHOTtruetrue620231227_211342__73130.0001453372.589582[103, 289]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_211342__731.json87.5missingmissingmissing
12347Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertAsk1SHOTfalsefalse620231227_211344__58700.0001000371.786530[103, 189]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231227_211344__587.json0.0missingmissingmissing
12348Apple-MacBook-Pro-M1wrap_stringmistral-tiny--optimJuliaExpertAsk1SHOTtruetrue620231215_202818__78300.01.883471[103, 212]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertAsk__1SHOT__20231215_202818__783.json62.50.9missing0.3
12349Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertCoTTask1SHOTtruetrue620231213_210652__20600.00017842114.14921[184, 337]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231213_210652__206.json62.5missingmissingmissing
12350Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertCoTTask1SHOTfalsefalse620231225_231951__77500.0001258737.17140[184, 221]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231951__775.json0.0missingmissingmissing
12351Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertCoTTask1SHOTtruetrue620231225_231954__45600.0002015243.390921[184, 388]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231225_231954__456.json62.5missingmissingmissing
12352Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertCoTTask1SHOTtruetrue620231227_211336__24340.00023368710.50772[184, 459]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211336__243.json91.6667missingmissingmissing
12353Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaExpertCoTTask1SHOTtruefalse620231227_211339__99100.0002010713.412050[184, 387]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231227_211339__991.json25.0missingmissingmissing
12354Apple-MacBook-Pro-M1wrap_stringmistral-tiny--optimJuliaExpertCoTTask1SHOTtruetrue620231215_202816__50400.04.700191[184, 328]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaExpertCoTTask__1SHOT__20231215_202816__504.json62.50.9missing0.3
12355Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapCoTTask1SHOTtruetrue620231213_210726__67900.0002835968.827891[369, 512]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231213_210726__679.json62.5missingmissingmissing
12356Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapCoTTask1SHOTtruetrue620231225_232021__79910.0002201763.26731[369, 372]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_232021__799.json66.6667missingmissingmissing
12357Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapCoTTask1SHOTtruetrue620231225_232024__84630.0002215353.299812[369, 375]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231225_232024__846.json87.5missingmissingmissing
12358Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapCoTTask1SHOTtruetrue620231227_211404__68830.0002695534.431462[369, 481]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211404__688.json87.5missingmissingmissing
12359Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapCoTTask1SHOTtruetrue620231227_211410__77900.000332525.520031[369, 620]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231227_211410__779.json62.5missingmissingmissing
12360Apple-MacBook-Pro-M1wrap_stringmistral-tiny--optimJuliaRecapCoTTask1SHOTtruetrue620231215_202831__17030.03.361232[369, 373]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapCoTTask__1SHOT__20231215_202831__170.json87.50.9missing0.3
12361Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapTask1SHOTtruetrue620231213_210717__19930.0002765218.752381[367, 497]0.10.0-DEV21.1{}MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231213_210717__199.json75.0missingmissingmissing
12362Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapTask1SHOTtruefalse620231225_232013__87900.0002126483.133050[367, 356]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_232013__879.json25.0missingmissingmissing
12363Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapTask1SHOTtruetrue620231225_232017__79000.00025073.91391[367, 440]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231225_232017__790.json62.5missingmissingmissing
12364Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapTask1SHOTtruetrue620231227_211356__33700.0003068725.212311[367, 564]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_211356__337.json62.5missingmissingmissing
12365Apple-MacBook-Pro-M1wrap_stringmistral-tinyJuliaRecapTask1SHOTfalsefalse620231227_211400__71600.0002466233.879560[367, 431]0.10.0-DEV21.1{}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231227_211400__716.json0.0missingmissingmissing
12366Apple-MacBook-Pro-M1wrap_stringmistral-tiny--optimJuliaRecapTask1SHOTtruetrue620231215_202828__77200.03.70351[367, 401]0.10.0-DEV21.1{\n "temperature": 0.9,\n "top_p": 0.3\n}PromptingTools.MistralOpenAISchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral-tiny/evaluation__JuliaRecapTask__1SHOT__20231215_202828__772.json62.50.9missing0.3
12367Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MAsIs1SHOTtruetrue620231225_081000__88000.01.314590[58, 25]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_081000__880.json50.0missing{\n "num_gpu": 99\n}missing
12368Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MAsIs1SHOTfalsefalse620231225_081003__20400.02.620590[58, 60]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__AsIs__1SHOT__20231225_081003__204.json0.0missing{\n "num_gpu": 99\n}missing
12369Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_080950__64300.012.19030[61, 311]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_080950__643.json50.0missing{\n "num_gpu": 99\n}missing
12370Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue620231225_080959__16020.08.370882[61, 211]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231225_080959__160.json83.3333missing{\n "num_gpu": 99\n}missing
12371Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MInJulia1SHOTtruetrue620231227_094353__65540.09.594072[61, 242]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__InJulia__1SHOT__20231227_094353__655.json91.6667missing{\n "num_gpu": 99\n}missing
12372Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_080928__99500.07.081540[102, 169]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080928__995.json50.0missing{\n "num_gpu": 99\n}missing
12373Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_080938__54620.09.889582[102, 242]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080938__546.json83.3333missing{\n "num_gpu": 99\n}missing
12374Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_094343__55000.08.309710[102, 200]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_094343__550.json50.0missing{\n "num_gpu": 99\n}missing
12375Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_080909__25600.023.76381[183, 428]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080909__256.json62.5missing{\n "num_gpu": 99\n}missing
12376Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_080921__50500.011.53660[183, 273]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080921__505.json50.0missing{\n "num_gpu": 99\n}missing
12377Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_094334__43300.024.47842[183, 463]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094334__433.json75.0missing{\n "num_gpu": 99\n}missing
12378Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_081045__81500.015.33860[369, 338]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081045__815.json50.0missing{\n "num_gpu": 99\n}missing
12379Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231225_081103__25200.018.16850[369, 408]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081103__252.json0.0missing{\n "num_gpu": 99\n}missing
12380Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231227_094423__54600.013.97830[369, 303]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094423__546.json0.0missing{\n "num_gpu": 99\n}missing
12381Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse620231225_081013__13900.010.04880[367, 206]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081013__139.json25.0missing{\n "num_gpu": 99\n}missing
12382Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_081029__19430.016.47722[367, 366]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081029__194.json87.5missing{\n "num_gpu": 99\n}missing
12383Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-q4_K_MJuliaRecapTask1SHOTtruefalse620231227_094409__55800.016.33170[367, 361]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094409__558.json25.0missing{\n "num_gpu": 99\n}missing
12384Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005246__17000.09.955550[60, 319]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005246__170.json50.0missing{\n "num_gpu": 99\n}missing
12385Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005303__61420.016.35050[60, 523]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005303__614.json58.3333missing{\n "num_gpu": 99\n}missing
12386Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005315__10800.011.67372[60, 374]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005315__108.json75.0missing{\n "num_gpu": 99\n}missing
12387Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruetrue620231228_005326__47200.011.09851[60, 356]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005326__472.json62.5missing{\n "num_gpu": 99\n}missing
12388Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0InJulia1SHOTtruefalse620231228_005338__97400.011.2610[60, 361]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__InJulia__1SHOT__20231228_005338__974.json25.0missing{\n "num_gpu": 99\n}missing
12389Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005201__60700.07.520450[101, 229]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005201__607.json50.0missing{\n "num_gpu": 99\n}missing
12390Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruefalse620231228_005207__27200.05.981510[101, 179]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005207__272.json25.0missing{\n "num_gpu": 99\n}missing
12391Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005220__47200.012.81790[101, 401]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005220__472.json50.0missing{\n "num_gpu": 99\n}missing
12392Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005227__48700.07.31741[101, 223]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005227__487.json62.5missing{\n "num_gpu": 99\n}missing
12393Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertAsk1SHOTtruetrue620231228_005236__65800.08.756510[101, 269]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertAsk__1SHOT__20231228_005236__658.json50.0missing{\n "num_gpu": 99\n}missing
12394Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005102__80800.011.39160[182, 310]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005102__808.json50.0missing{\n "num_gpu": 99\n}missing
12395Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005119__55800.016.52650[182, 501]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005119__558.json50.0missing{\n "num_gpu": 99\n}missing
12396Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005131__99900.011.89571[182, 358]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005131__999.json62.5missing{\n "num_gpu": 99\n}missing
12397Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005146__78500.014.91411[182, 453]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005146__785.json62.5missing{\n "num_gpu": 99\n}missing
12398Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaExpertCoTTask1SHOTtruetrue620231228_005154__87100.07.588891[182, 220]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005154__871.json62.5missing{\n "num_gpu": 99\n}missing
12399Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005511__90400.012.64591[368, 345]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005511__904.json62.5missing{\n "num_gpu": 99\n}missing
12400Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005521__63000.09.669160[368, 253]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005521__630.json50.0missing{\n "num_gpu": 99\n}missing
12401Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005537__69900.016.26730[368, 456]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005537__699.json50.0missing{\n "num_gpu": 99\n}missing
12402Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005553__17200.015.99330[368, 448]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005553__172.json50.0missing{\n "num_gpu": 99\n}missing
12403Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapCoTTask1SHOTtruetrue620231228_005609__43720.015.38992[368, 430]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapCoTTask__1SHOT__20231228_005609__437.json83.3333missing{\n "num_gpu": 99\n}missing
12404Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue620231228_005354__86300.016.55081[366, 465]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005354__863.json62.5missing{\n "num_gpu": 99\n}missing
12405Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse620231228_005408__62200.013.94410[366, 386]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005408__622.json25.0missing{\n "num_gpu": 99\n}missing
12406Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue620231228_005423__24600.014.46431[366, 402]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005423__246.json62.5missing{\n "num_gpu": 99\n}missing
12407Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruefalse620231228_005441__35200.018.25810[366, 517]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005441__352.json25.0missing{\n "num_gpu": 99\n}missing
12408Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_0JuliaRecapTask1SHOTtruetrue620231228_005458__63200.016.92081[366, 476]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_0/evaluation__JuliaRecapTask__1SHOT__20231228_005458__632.json62.5missing{\n "num_gpu": 99\n}missing
12409Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTfalsefalse620231228_005845__66000.019.26720[60, 487]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005845__660.json0.0missing{\n "num_gpu": 99\n}missing
12410Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005900__45900.014.77231[60, 374]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005900__459.json62.5missing{\n "num_gpu": 99\n}missing
12411Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005917__70500.016.75261[60, 424]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005917__705.json62.5missing{\n "num_gpu": 99\n}missing
12412Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005940__74420.023.70662[60, 598]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005940__744.json83.3333missing{\n "num_gpu": 99\n}missing
12413Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MInJulia1SHOTtruetrue620231228_005954__60000.013.80821[60, 349]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__InJulia__1SHOT__20231228_005954__600.json62.5missing{\n "num_gpu": 99\n}missing
12414Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse620231228_005745__27800.011.73190[101, 287]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005745__278.json25.0missing{\n "num_gpu": 99\n}missing
12415Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue620231228_005754__19700.09.856061[101, 239]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005754__197.json62.5missing{\n "num_gpu": 99\n}missing
12416Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruefalse620231228_005808__10300.013.27070[101, 326]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005808__103.json25.0missing{\n "num_gpu": 99\n}missing
12417Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue620231228_005818__74500.010.0921[101, 245]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005818__745.json62.5missing{\n "num_gpu": 99\n}missing
12418Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertAsk1SHOTtruetrue620231228_005825__70800.07.343171[101, 174]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231228_005825__708.json62.5missing{\n "num_gpu": 99\n}missing
12419Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231228_005632__20100.022.63910[182, 518]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005632__201.json50.0missing{\n "num_gpu": 99\n}missing
12420Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620231228_005643__89700.011.28980[182, 265]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005643__897.json25.0missing{\n "num_gpu": 99\n}missing
12421Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231228_005657__41900.014.54150[182, 347]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005657__419.json0.0missing{\n "num_gpu": 99\n}missing
12422Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231228_005717__83200.019.38880[182, 468]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005717__832.json0.0missing{\n "num_gpu": 99\n}missing
12423Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231228_005733__38900.015.90330[182, 381]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231228_005733__389.json50.0missing{\n "num_gpu": 99\n}missing
12424Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231228_010144__79400.018.77750[368, 419]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010144__794.json0.0missing{\n "num_gpu": 99\n}missing
12425Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010204__99700.020.52941[368, 462]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010204__997.json62.5missing{\n "num_gpu": 99\n}missing
12426Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010224__59530.019.91341[368, 447]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010224__595.json75.0missing{\n "num_gpu": 99\n}missing
12427Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010242__71300.017.82660[368, 396]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010242__713.json50.0missing{\n "num_gpu": 99\n}missing
12428Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231228_010300__48900.017.34321[368, 384]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231228_010300__489.json62.5missing{\n "num_gpu": 99\n}missing
12429Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010010__50600.015.46811[366, 338]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010010__506.json62.5missing{\n "num_gpu": 99\n}missing
12430Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010032__22800.021.8621[366, 494]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010032__228.json62.5missing{\n "num_gpu": 99\n}missing
12431Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruefalse620231228_010051__44200.019.3450[366, 433]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010051__442.json25.0missing{\n "num_gpu": 99\n}missing
12432Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010111__89310.019.62232[366, 440]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010111__893.json79.1667missing{\n "num_gpu": 99\n}missing
12433Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q4_K_MJuliaRecapTask1SHOTtruetrue620231228_010125__81720.013.59992[366, 292]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231228_010125__817.json83.3333missing{\n "num_gpu": 99\n}missing
12434Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse620231226_124651__84700.015.29310[57, 278]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_124651__847.json0.0missing{\n "num_gpu": 99\n}missing
12435Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KAsIs1SHOTfalsefalse620231226_124714__92000.023.70530[57, 416]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__AsIs__1SHOT__20231226_124714__920.json0.0missing{\n "num_gpu": 99\n}missing
12436Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue620231226_124611__54800.021.51961[60, 380]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124611__548.json62.5missing{\n "num_gpu": 99\n}missing
12437Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue620231226_124635__58710.024.12132[60, 437]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231226_124635__587.json79.1667missing{\n "num_gpu": 99\n}missing
12438Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KInJulia1SHOTtruetrue620231227_094735__66300.025.54071[60, 473]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__InJulia__1SHOT__20231227_094735__663.json62.5missing{\n "num_gpu": 99\n}missing
12439Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue620231226_124531__66200.016.14851[101, 289]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124531__662.json62.5missing{\n "num_gpu": 99\n}missing
12440Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruefalse620231226_124549__93200.018.08810[101, 316]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231226_124549__932.json25.0missing{\n "num_gpu": 99\n}missing
12441Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertAsk1SHOTtruetrue620231227_094709__10900.013.22571[101, 237]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_094709__109.json62.5missing{\n "num_gpu": 99\n}missing
12442Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse620231226_124450__59100.018.78430[182, 328]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124450__591.json25.0missing{\n "num_gpu": 99\n}missing
12443Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruetrue620231226_124515__12300.024.87811[182, 432]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231226_124515__123.json62.5missing{\n "num_gpu": 99\n}missing
12444Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaExpertCoTTask1SHOTtruefalse620231227_094656__89800.029.75090[182, 369]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094656__898.json25.0missing{\n "num_gpu": 99\n}missing
12445Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue620231226_124828__34800.021.38321[368, 354]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124828__348.json62.5missing{\n "num_gpu": 99\n}missing
12446Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue620231226_124905__90100.036.9061[368, 628]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231226_124905__901.json62.5missing{\n "num_gpu": 99\n}missing
12447Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapCoTTask1SHOTtruetrue620231227_094821__16820.022.18922[368, 370]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094821__168.json83.3333missing{\n "num_gpu": 99\n}missing
12448Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTfalsefalse620231226_124740__34300.025.55040[366, 418]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124740__343.json0.0missing{\n "num_gpu": 99\n}missing
12449Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse620231226_124806__33500.026.30050[366, 439]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231226_124806__335.json25.0missing{\n "num_gpu": 99\n}missing
12450Apple-MacBook-Pro-M1wrap_stringmistral:7b-instruct-v0.2-q6_KJuliaRecapTask1SHOTtruefalse620231227_094759__58200.024.18180[366, 406]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/mistral:7b-instruct-v0.2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_094759__582.json25.0missing{\n "num_gpu": 99\n}missing
12451Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue620231227_095221__95100.058.02390[65, 343]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_095221__951.json50.0missing{\n "num_gpu": 99\n}missing
12452Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTfalsefalse620231227_134039__38900.028.31660[65, 162]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_134039__389.json0.0missing{\n "num_gpu": 99\n}missing
12453Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue620231227_134121__59600.041.47991[65, 243]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_134121__596.json62.5missing{\n "num_gpu": 99\n}missing
12454Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MInJulia1SHOTtruetrue620231227_134157__18800.036.60991[65, 213]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__InJulia__1SHOT__20231227_134157__188.json62.5missing{\n "num_gpu": 99\n}missing
12455Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_095123__54800.050.26351[104, 290]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_095123__548.json62.5missing{\n "num_gpu": 99\n}missing
12456Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse620231227_133815__46700.026.57510[104, 146]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_133815__467.json0.0missing{\n "num_gpu": 99\n}missing
12457Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_133902__67200.046.81980[104, 270]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_133902__672.json50.0missing{\n "num_gpu": 99\n}missing
12458Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertAsk1SHOTfalsefalse620231227_134011__75200.068.7040[104, 402]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_134011__752.json0.0missing{\n "num_gpu": 99\n}missing
12459Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_095033__82200.077.51151[184, 298]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_095033__822.json62.5missing{\n "num_gpu": 99\n}missing
12460Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_133550__91920.065.29412[184, 343]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133550__919.json83.3333missing{\n "num_gpu": 99\n}missing
12461Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_133655__93800.065.47881[184, 370]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133655__938.json62.5missing{\n "num_gpu": 99\n}missing
12462Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_133748__31900.052.76431[184, 294]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_133748__319.json62.5missing{\n "num_gpu": 99\n}missing
12463Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_095447__64600.065.77571[378, 335]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_095447__646.json62.5missing{\n "num_gpu": 99\n}missing
12464Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_134626__85220.045.07872[378, 212]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_134626__852.json83.3333missing{\n "num_gpu": 99\n}missing
12465Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231227_140032__98200.020.21290[378, 5]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_140032__982.json0.0missing{\n "num_gpu": 99\n}missing
12466Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_140259__86900.0146.5941[378, 769]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_140259__869.json62.5missing{\n "num_gpu": 99\n}missing
12467Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_095341__34600.079.89640[376, 418]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_095341__346.json50.0missing{\n "num_gpu": 99\n}missing
12468Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTfalsefalse620231227_134300__78100.061.99050[376, 314]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_134300__781.json0.0missing{\n "num_gpu": 99\n}missing
12469Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_134432__76500.092.86840[376, 494]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_134432__765.json50.0missing{\n "num_gpu": 99\n}missing
12470Apple-MacBook-Pro-M1wrap_stringnous-hermes2:34b-yi-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_134540__54640.067.39542[376, 344]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/nous-hermes2:34b-yi-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_134540__546.json91.6667missing{\n "num_gpu": 99\n}missing
12471Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse620231225_081247__86400.09.446590[66, 235]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_081247__864.json0.0missing{\n "num_gpu": 99\n}missing
12472Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MAsIs1SHOTfalsefalse620231225_081257__82200.010.50840[66, 263]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__AsIs__1SHOT__20231225_081257__822.json0.0missing{\n "num_gpu": 99\n}missing
12473Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue620231225_081227__25540.011.66572[69, 293]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_081227__255.json91.6667missing{\n "num_gpu": 99\n}missing
12474Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue620231225_081237__39430.010.03982[69, 251]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231225_081237__394.json87.5missing{\n "num_gpu": 99\n}missing
12475Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MInJulia1SHOTtruetrue620231227_094502__52600.013.04140[69, 325]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__InJulia__1SHOT__20231227_094502__526.json50.0missing{\n "num_gpu": 99\n}missing
12476Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_081201__33000.012.04880[110, 297]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_081201__330.json50.0missing{\n "num_gpu": 99\n}missing
12477Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_081215__78120.013.65572[110, 338]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_081215__781.json83.3333missing{\n "num_gpu": 99\n}missing
12478Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertAsk1SHOTtruetrue620231227_094449__27900.011.27171[110, 262]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_094449__279.json62.5missing{\n "num_gpu": 99\n}missing
12479Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruefalse620231225_081134__64000.030.20010[191, 581]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081134__640.json25.0missing{\n "num_gpu": 99\n}missing
12480Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_081149__59210.015.2212[191, 366]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081149__592.json79.1667missing{\n "num_gpu": 99\n}missing
12481Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231227_094437__32950.014.0972[191, 183]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094437__329.json95.8333missing{\n "num_gpu": 99\n}missing
12482Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_081343__91530.017.26082[377, 385]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081343__915.json87.5missing{\n "num_gpu": 99\n}missing
12483Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_081358__47140.014.81132[377, 324]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081358__471.json91.6667missing{\n "num_gpu": 99\n}missing
12484Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_094526__44140.011.85382[377, 249]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094526__441.json91.6667missing{\n "num_gpu": 99\n}missing
12485Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_081311__26610.013.21430[375, 285]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081311__266.json54.1667missing{\n "num_gpu": 99\n}missing
12486Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_081326__99450.014.87952[375, 326]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_081326__994.json95.8333missing{\n "num_gpu": 99\n}missing
12487Apple-MacBook-Pro-M1wrap_stringopenchat:7b-v3.5-1210-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_094514__43930.012.20262[375, 257]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openchat:7b-v3.5-1210-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094514__439.json87.5missing{\n "num_gpu": 99\n}missing
12488Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralAsIs1SHOTfalsefalse620231214_090158__38300.09.819350[48, 299]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231214_090158__383.json0.0missingmissingmissing
12489Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralAsIs1SHOTfalsefalse620231225_071534__21900.09.326180[64, 296]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_071534__219.json0.0missing{\n "num_gpu": 99\n}missing
12490Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralAsIs1SHOTfalsefalse620231225_071550__94500.016.22390[64, 515]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__AsIs__1SHOT__20231225_071550__945.json0.0missing{\n "num_gpu": 99\n}missing
12491Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231214_090148__77200.020.10720[65, 589]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231214_090148__772.json50.0missingmissingmissing
12492Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231225_071514__81720.012.25692[67, 384]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_071514__817.json83.3333missing{\n "num_gpu": 99\n}missing
12493Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231225_071524__21940.09.712421[67, 304]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231225_071524__219.json79.1667missing{\n "num_gpu": 99\n}missing
12494Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralInJulia1SHOTtruetrue620231227_092121__91400.019.25980[67, 618]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__InJulia__1SHOT__20231227_092121__914.json50.0missing{\n "num_gpu": 99\n}missing
12495Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231214_090128__59700.06.778090[94, 195]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231214_090128__597.json50.0missingmissingmissing
12496Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231225_071451__34600.09.771292[108, 299]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_071451__346.json75.0missing{\n "num_gpu": 99\n}missing
12497Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231225_071502__47510.011.32872[108, 349]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231225_071502__475.json79.1667missing{\n "num_gpu": 99\n}missing
12498Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertAsk1SHOTtruetrue620231227_092102__59720.010.15312[108, 320]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertAsk__1SHOT__20231227_092102__597.json83.3333missing{\n "num_gpu": 99\n}missing
12499Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTfalsefalse620231214_090121__67700.012.20[175, 328]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090121__677.json0.0missingmissingmissing
12500Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruefalse620231225_071430__18500.015.83920[189, 308]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071430__185.json25.0missing{\n "num_gpu": 99\n}missing
12501Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue620231225_071441__41710.010.35512[189, 306]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071441__417.json79.1667missing{\n "num_gpu": 99\n}missing
12502Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaExpertCoTTask1SHOTtruetrue620231227_092051__89800.019.03550[189, 434]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092051__898.json50.0missing{\n "num_gpu": 99\n}missing
12503Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTfalsefalse620231214_090220__25500.01.492270[11, 38]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090220__255.json0.0missingmissingmissing
12504Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue620231225_071646__63750.020.08252[375, 565]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071646__637.json95.8333missing{\n "num_gpu": 99\n}missing
12505Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue620231225_071657__10600.010.58120[375, 279]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071657__106.json50.0missing{\n "num_gpu": 99\n}missing
12506Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapCoTTask1SHOTtruetrue620231227_092148__68800.013.6642[375, 383]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092148__688.json75.0missing{\n "num_gpu": 99\n}missing
12507Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTfalsefalse620231214_090219__81900.021.05180[365, 491]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231214_090219__819.json0.0missingmissingmissing
12508Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue620231225_071607__83400.016.63051[373, 462]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_071607__834.json62.5missing{\n "num_gpu": 99\n}missing
12509Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue620231225_071626__13100.019.08752[373, 537]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231225_071626__131.json75.0missing{\n "num_gpu": 99\n}missing
12510Apple-MacBook-Pro-M1wrap_stringopenhermes2.5-mistralJuliaRecapTask1SHOTtruetrue620231227_092135__45820.013.37052[373, 374]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/openhermes2.5-mistral/evaluation__JuliaRecapTask__1SHOT__20231227_092135__458.json83.3333missing{\n "num_gpu": 99\n}missing
12511Apple-MacBook-Pro-M1wrap_stringorca2:13bAsIs1SHOTfalsefalse620231214_091307__55600.023.47190[48, 683]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__AsIs__1SHOT__20231214_091307__556.json0.0missingmissingmissing
12512Apple-MacBook-Pro-M1wrap_stringorca2:13bAsIs1SHOTfalsefalse620231225_074035__61900.026.45360[65, 477]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__AsIs__1SHOT__20231225_074035__619.json0.0missing{\n "num_gpu": 99\n}missing
12513Apple-MacBook-Pro-M1wrap_stringorca2:13bAsIs1SHOTfalsefalse620231225_074056__84200.021.12340[65, 379]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__AsIs__1SHOT__20231225_074056__842.json0.0missing{\n "num_gpu": 99\n}missing
12514Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTtruetrue620231214_091243__88200.015.56530[65, 462]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231214_091243__882.json50.0missingmissingmissing
12515Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTfalsefalse620231225_073950__10600.03.413980[68, 50]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231225_073950__106.json0.0missing{\n "num_gpu": 99\n}missing
12516Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTtruetrue620231225_074008__13860.018.42662[68, 331]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231225_074008__138.json100.0missing{\n "num_gpu": 99\n}missing
12517Apple-MacBook-Pro-M1wrap_stringorca2:13bInJulia1SHOTtruetrue620231227_093025__21900.023.13591[68, 422]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__InJulia__1SHOT__20231227_093025__219.json62.5missing{\n "num_gpu": 99\n}missing
12518Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTtruetrue620231214_091227__28800.07.289970[94, 211]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231214_091227__288.json50.0missingmissingmissing
12519Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTtruetrue620231225_073930__19710.021.60252[107, 381]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_073930__197.json79.1667missing{\n "num_gpu": 99\n}missing
12520Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTfalsefalse620231225_073946__76100.016.60540[107, 292]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231225_073946__761.json0.0missing{\n "num_gpu": 99\n}missing
12521Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertAsk1SHOTfalsefalse620231227_093002__19900.013.89470[107, 245]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertAsk__1SHOT__20231227_093002__199.json0.0missing{\n "num_gpu": 99\n}missing
12522Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231214_091220__56600.012.35130[175, 332]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231214_091220__566.json0.0missingmissingmissing
12523Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231225_073848__12000.026.79050[188, 285]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073848__120.json0.0missing{\n "num_gpu": 99\n}missing
12524Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231225_073908__68400.019.64670[188, 331]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073908__684.json0.0missing{\n "num_gpu": 99\n}missing
12525Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaExpertCoTTask1SHOTfalsefalse620231227_092948__46900.021.70380[188, 200]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092948__469.json0.0missing{\n "num_gpu": 99\n}missing
12526Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTfalsefalse620231214_091351__55800.014.04630[11, 389]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091351__558.json0.0missingmissingmissing
12527Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTtruetrue620231225_074159__13560.036.46832[371, 587]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_074159__135.json100.0missing{\n "num_gpu": 99\n}missing
12528Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTfalsefalse620231225_074205__74000.05.644470[371, 47]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231225_074205__740.json0.0missing{\n "num_gpu": 99\n}missing
12529Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapCoTTask1SHOTtruetrue620231227_093134__69200.038.40272[371, 615]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapCoTTask__1SHOT__20231227_093134__692.json75.0missing{\n "num_gpu": 99\n}missing
12530Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTfalsefalse620231214_091337__23400.030.05250[365, 715]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231214_091337__234.json0.0missingmissingmissing
12531Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTfalsefalse620231225_074102__24500.05.596210[368, 46]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_074102__245.json0.0missing{\n "num_gpu": 99\n}missing
12532Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTfalsefalse620231225_074123__67300.020.98420[368, 323]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231225_074123__673.json0.0missing{\n "num_gpu": 99\n}missing
12533Apple-MacBook-Pro-M1wrap_stringorca2:13bJuliaRecapTask1SHOTtruetrue620231227_093056__21110.029.9972[368, 482]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/orca2:13b/evaluation__JuliaRecapTask__1SHOT__20231227_093056__211.json79.1667missing{\n "num_gpu": 99\n}missing
12534Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse620231225_081529__92200.014.61080[54, 565]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_081529__922.json0.0missing{\n "num_gpu": 99\n}missing
12535Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KAsIs1SHOTfalsefalse620231225_081548__63100.018.93520[54, 723]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__AsIs__1SHOT__20231225_081548__631.json0.0missing{\n "num_gpu": 99\n}missing
12536Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse620231225_081508__27800.05.283980[57, 208]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_081508__278.json0.0missing{\n "num_gpu": 99\n}missing
12537Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse620231225_081515__11000.07.245170[57, 285]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231225_081515__110.json0.0missing{\n "num_gpu": 99\n}missing
12538Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KInJulia1SHOTfalsefalse620231227_094559__60200.07.9720[57, 310]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__InJulia__1SHOT__20231227_094559__602.json0.0missing{\n "num_gpu": 99\n}missing
12539Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse620231225_081432__14400.019.36510[94, 729]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_081432__144.json0.0missing{\n "num_gpu": 99\n}missing
12540Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse620231225_081502__39000.029.85620[94, 1085]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231225_081502__390.json0.0missing{\n "num_gpu": 99\n}missing
12541Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertAsk1SHOTfalsefalse620231227_094551__99500.015.25660[94, 575]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertAsk__1SHOT__20231227_094551__995.json0.0missing{\n "num_gpu": 99\n}missing
12542Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231225_081409__99700.010.52710[173, 248]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081409__997.json0.0missing{\n "num_gpu": 99\n}missing
12543Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231225_081413__56100.04.533240[173, 159]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231225_081413__561.json0.0missing{\n "num_gpu": 99\n}missing
12544Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaExpertCoTTask1SHOTfalsefalse620231227_094536__88300.09.378420[173, 210]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094536__883.json0.0missing{\n "num_gpu": 99\n}missing
12545Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231225_081634__22900.011.11420[346, 376]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081634__229.json0.0missing{\n "num_gpu": 99\n}missing
12546Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231225_081635__23300.01.118850[346, 1]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231225_081635__233.json0.0missing{\n "num_gpu": 99\n}missing
12547Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapCoTTask1SHOTfalsefalse620231227_094626__32500.015.51980[346, 529]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094626__325.json0.0missing{\n "num_gpu": 99\n}missing
12548Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse620231225_081559__35800.010.83540[343, 366]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_081559__358.json0.0missing{\n "num_gpu": 99\n}missing
12549Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse620231225_081623__95500.023.68780[343, 811]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231225_081623__955.json0.0missing{\n "num_gpu": 99\n}missing
12550Apple-MacBook-Pro-M1wrap_stringphi:2.7b-chat-v2-q6_KJuliaRecapTask1SHOTfalsefalse620231227_094610__58400.011.4820[343, 387]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phi:2.7b-chat-v2-q6_K/evaluation__JuliaRecapTask__1SHOT__20231227_094610__584.json0.0missing{\n "num_gpu": 99\n}missing
12551Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2AsIs1SHOTfalsefalse620231214_091442__23200.013.62910[48, 411]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231214_091442__232.json0.0missingmissingmissing
12552Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2AsIs1SHOTfalsefalse620231225_074700__57800.036.25340[73, 274]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_074700__578.json0.0missing{\n "num_gpu": 99\n}missing
12553Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2AsIs1SHOTtruetrue620231225_074741__56250.040.99882[73, 308]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__AsIs__1SHOT__20231225_074741__562.json95.8333missing{\n "num_gpu": 99\n}missing
12554Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTfalsefalse620231214_091429__42900.013.7570[65, 410]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231214_091429__429.json0.0missingmissingmissing
12555Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruetrue620231225_074546__61610.039.58852[76, 301]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_074546__616.json79.1667missing{\n "num_gpu": 99\n}missing
12556Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruetrue620231225_074624__55020.038.33522[76, 290]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231225_074624__550.json83.3333missing{\n "num_gpu": 99\n}missing
12557Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2InJulia1SHOTtruetrue620231227_093338__88430.036.56892[76, 282]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__InJulia__1SHOT__20231227_093338__884.json87.5missing{\n "num_gpu": 99\n}missing
12558Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231214_091415__43100.010.43330[94, 306]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231214_091415__431.json50.0missingmissingmissing
12559Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231225_074419__95460.036.15012[115, 270]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_074419__954.json100.0missing{\n "num_gpu": 99\n}missing
12560Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231225_074506__80050.046.21492[115, 350]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231225_074506__800.json95.8333missing{\n "num_gpu": 99\n}missing
12561Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertAsk1SHOTtruetrue620231227_093302__42630.030.69012[115, 229]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertAsk__1SHOT__20231227_093302__426.json87.5missing{\n "num_gpu": 99\n}missing
12562Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231214_091404__14800.013.29910[175, 359]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231214_091404__148.json50.0missingmissingmissing
12563Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231225_074254__42000.049.15831[196, 171]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_074254__420.json62.5missing{\n "num_gpu": 99\n}missing
12564Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231225_074343__39760.048.43832[196, 341]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231225_074343__397.json100.0missing{\n "num_gpu": 99\n}missing
12565Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaExpertCoTTask1SHOTtruetrue620231227_093231__46050.056.60442[196, 249]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaExpertCoTTask__1SHOT__20231227_093231__460.json95.8333missing{\n "num_gpu": 99\n}missing
12566Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231214_091524__52000.018.31412[11, 500]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091524__520.json75.0missingmissingmissing
12567Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231225_075003__53630.039.09952[379, 241]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_075003__536.json87.5missing{\n "num_gpu": 99\n}missing
12568Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231225_075049__76750.045.4012[379, 289]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231225_075049__767.json95.8333missing{\n "num_gpu": 99\n}missing
12569Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapCoTTask1SHOTtruetrue620231227_093459__95350.040.22782[379, 258]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapCoTTask__1SHOT__20231227_093459__953.json95.8333missing{\n "num_gpu": 99\n}missing
12570Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTfalsefalse620231214_091506__20600.023.35950[365, 550]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231214_091506__206.json0.0missingmissingmissing
12571Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue620231225_074822__97430.040.08882[376, 249]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_074822__974.json87.5missing{\n "num_gpu": 99\n}missing
12572Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue620231225_074923__53150.061.40462[376, 412]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231225_074923__531.json95.8333missing{\n "num_gpu": 99\n}missing
12573Apple-MacBook-Pro-M1wrap_stringphind-codellama:34b-v2JuliaRecapTask1SHOTtruetrue620231227_093418__75120.039.85722[376, 256]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/phind-codellama:34b-v2/evaluation__JuliaRecapTask__1SHOT__20231227_093418__751.json83.3333missing{\n "num_gpu": 99\n}missing
12574Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse620231225_080701__49100.021.07460[66, 358]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_080701__491.json0.0missing{\n "num_gpu": 99\n}missing
12575Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MAsIs1SHOTfalsefalse620231225_080717__23500.015.65460[66, 264]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__AsIs__1SHOT__20231225_080717__235.json0.0missing{\n "num_gpu": 99\n}missing
12576Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue620231225_080618__30320.014.17452[69, 238]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_080618__303.json83.3333missing{\n "num_gpu": 99\n}missing
12577Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTfalsefalse620231225_080640__47800.022.23350[69, 378]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231225_080640__478.json0.0missing{\n "num_gpu": 99\n}missing
12578Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MInJulia1SHOTtruetrue620231227_094228__57030.027.7342[69, 471]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__InJulia__1SHOT__20231227_094228__570.json87.5missing{\n "num_gpu": 99\n}missing
12579Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTfalsefalse620231225_080545__81900.019.65350[110, 327]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080545__819.json0.0missing{\n "num_gpu": 99\n}missing
12580Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruetrue620231225_080603__86600.017.86430[110, 296]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231225_080603__866.json50.0missing{\n "num_gpu": 99\n}missing
12581Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertAsk1SHOTtruefalse620231227_094200__13200.019.73210[110, 328]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertAsk__1SHOT__20231227_094200__132.json25.0missing{\n "num_gpu": 99\n}missing
12582Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTtruetrue620231225_080511__58300.031.32710[191, 315]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080511__583.json50.0missing{\n "num_gpu": 99\n}missing
12583Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231225_080525__14300.013.16280[191, 200]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231225_080525__143.json0.0missing{\n "num_gpu": 99\n}missing
12584Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaExpertCoTTask1SHOTfalsefalse620231227_094140__71400.027.93010[191, 306]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaExpertCoTTask__1SHOT__20231227_094140__714.json0.0missing{\n "num_gpu": 99\n}missing
12585Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231225_080828__19400.020.21832[377, 295]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080828__194.json75.0missing{\n "num_gpu": 99\n}missing
12586Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTfalsefalse620231225_080845__17300.017.03020[377, 241]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231225_080845__173.json0.0missing{\n "num_gpu": 99\n}missing
12587Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapCoTTask1SHOTtruetrue620231227_094310__36200.022.56460[377, 333]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapCoTTask__1SHOT__20231227_094310__362.json50.0missing{\n "num_gpu": 99\n}missing
12588Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTfalsefalse620231225_080745__91800.028.13640[375, 426]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080745__918.json0.0missing{\n "num_gpu": 99\n}missing
12589Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue620231225_080808__15900.022.38290[375, 331]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231225_080808__159.json50.0missing{\n "num_gpu": 99\n}missing
12590Apple-MacBook-Pro-M1wrap_stringsolar:10.7b-instruct-v1-q4_K_MJuliaRecapTask1SHOTtruetrue620231227_094247__53500.019.32061[375, 279]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/solar:10.7b-instruct-v1-q4_K_M/evaluation__JuliaRecapTask__1SHOT__20231227_094247__535.json62.5missing{\n "num_gpu": 99\n}missing
12591Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrAsIs1SHOTfalsefalse620231214_091133__85500.011.89130[48, 360]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__AsIs__1SHOT__20231214_091133__855.json0.0missingmissingmissing
12592Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrAsIs1SHOTfalsefalse620231225_073747__87300.05.672580[67, 322]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_073747__873.json0.0missing{\n "num_gpu": 99\n}missing
12593Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrAsIs1SHOTfalsefalse620231225_073755__29300.07.995530[67, 449]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__AsIs__1SHOT__20231225_073755__293.json0.0missing{\n "num_gpu": 99\n}missing
12594Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTfalsefalse620231214_091121__50200.016.08640[65, 477]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231214_091121__502.json0.0missingmissingmissing
12595Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTfalsefalse620231225_073733__65300.05.005420[70, 282]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_073733__653.json0.0missing{\n "num_gpu": 99\n}missing
12596Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTfalsefalse620231225_073741__85600.07.459590[70, 415]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231225_073741__856.json0.0missing{\n "num_gpu": 99\n}missing
12597Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrInJulia1SHOTfalsefalse620231227_092915__42300.09.959840[70, 554]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__InJulia__1SHOT__20231227_092915__423.json0.0missing{\n "num_gpu": 99\n}missing
12598Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruefalse620231214_091105__30000.012.36370[94, 361]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231214_091105__300.json25.0missingmissingmissing
12599Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTfalsefalse620231225_073723__37500.07.038850[107, 386]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_073723__375.json0.0missing{\n "num_gpu": 99\n}missing
12600Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruetrue620231225_073728__70910.05.118380[107, 281]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231225_073728__709.json54.1667missing{\n "num_gpu": 99\n}missing
12601Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertAsk1SHOTtruefalse620231227_092905__22200.07.441190[107, 412]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertAsk__1SHOT__20231227_092905__222.json25.0missing{\n "num_gpu": 99\n}missing
12602Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTtruetrue620231214_091052__56100.013.5250[175, 366]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231214_091052__561.json50.0missingmissingmissing
12603Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse620231225_073708__32500.07.135760[184, 216]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073708__325.json0.0missing{\n "num_gpu": 99\n}missing
12604Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse620231225_073716__95900.08.275530[184, 434]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231225_073716__959.json0.0missing{\n "num_gpu": 99\n}missing
12605Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaExpertCoTTask1SHOTfalsefalse620231227_092857__74600.06.950430[184, 225]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092857__746.json0.0missing{\n "num_gpu": 99\n}missing
12606Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse620231214_091208__38100.014.8570[11, 409]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231214_091208__381.json0.0missingmissingmissing
12607Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse620231225_073817__63800.06.373160[357, 285]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073817__638.json0.0missing{\n "num_gpu": 99\n}missing
12608Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTfalsefalse620231225_073822__53100.04.519730[357, 190]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073822__531.json0.0missing{\n "num_gpu": 99\n}missing
12609Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapCoTTask1SHOTtruetrue620231227_092927__31210.04.361260[357, 183]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092927__312.json54.1667missing{\n "num_gpu": 99\n}missing
12610Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTtruetrue620231214_091153__60300.020.06772[365, 466]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231214_091153__603.json75.0missingmissingmissing
12611Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTfalsefalse620231225_073804__81100.09.034370[355, 421]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_073804__811.json0.0missing{\n "num_gpu": 99\n}missing
12612Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTfalsefalse620231225_073811__37000.06.923990[355, 316]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231225_073811__370.json0.0missing{\n "num_gpu": 99\n}missing
12613Apple-MacBook-Pro-M1wrap_stringstablelm-zephyrJuliaRecapTask1SHOTfalsefalse620231227_092922__45600.07.352130[355, 339]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/stablelm-zephyr/evaluation__JuliaRecapTask__1SHOT__20231227_092922__456.json0.0missing{\n "num_gpu": 99\n}missing
12614Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestAsIs1SHOTfalsefalse620231214_090311__42000.012.64120[48, 382]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__AsIs__1SHOT__20231214_090311__420.json0.0missingmissingmissing
12615Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestAsIs1SHOTfalsefalse620231225_071818__31700.011.88260[66, 373]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_071818__317.json0.0missing{\n "num_gpu": 99\n}missing
12616Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestAsIs1SHOTfalsefalse620231225_071827__55500.09.547150[66, 299]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__AsIs__1SHOT__20231225_071827__555.json0.0missing{\n "num_gpu": 99\n}missing
12617Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231214_090258__56200.015.91270[65, 471]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231214_090258__562.json50.0missingmissingmissing
12618Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231225_071754__15710.017.26332[69, 542]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_071754__157.json79.1667missing{\n "num_gpu": 99\n}missing
12619Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231225_071806__52800.011.14522[69, 349]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231225_071806__528.json75.0missing{\n "num_gpu": 99\n}missing
12620Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestInJulia1SHOTtruetrue620231227_092224__21110.011.93932[69, 384]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__InJulia__1SHOT__20231227_092224__211.json79.1667missing{\n "num_gpu": 99\n}missing
12621Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231214_090242__29900.010.94480[94, 321]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231214_090242__299.json50.0missingmissingmissing
12622Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231225_071730__26740.010.20442[110, 313]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_071730__267.json91.6667missing{\n "num_gpu": 99\n}missing
12623Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231225_071737__51940.07.127492[110, 214]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231225_071737__519.json91.6667missing{\n "num_gpu": 99\n}missing
12624Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertAsk1SHOTtruetrue620231227_092212__32320.010.55192[110, 332]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertAsk__1SHOT__20231227_092212__323.json83.3333missing{\n "num_gpu": 99\n}missing
12625Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse620231214_090231__67700.011.01010[175, 294]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090231__677.json0.0missingmissingmissing
12626Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue620231225_071712__66200.014.68290[191, 262]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071712__662.json50.0missing{\n "num_gpu": 99\n}missing
12627Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTtruetrue620231225_071719__57300.07.108440[191, 202]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231225_071719__573.json50.0missing{\n "num_gpu": 99\n}missing
12628Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaExpertCoTTask1SHOTfalsefalse620231227_092202__74300.013.33210[191, 243]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092202__743.json0.0missing{\n "num_gpu": 99\n}missing
12629Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse620231214_090358__29200.022.52140[11, 606]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090358__292.json0.0missingmissingmissing
12630Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue620231225_071903__10300.013.460[377, 366]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071903__103.json50.0missing{\n "num_gpu": 99\n}missing
12631Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTtruetrue620231225_071919__30500.015.63010[377, 431]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231225_071919__305.json50.0missing{\n "num_gpu": 99\n}missing
12632Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapCoTTask1SHOTfalsefalse620231227_092250__34900.010.62430[377, 287]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092250__349.json0.0missing{\n "num_gpu": 99\n}missing
12633Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231214_090336__71300.024.54930[365, 580]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231214_090336__713.json50.0missingmissingmissing
12634Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231225_071839__49400.011.81572[375, 316]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_071839__494.json75.0missing{\n "num_gpu": 99\n}missing
12635Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231225_071849__20200.09.80790[375, 255]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231225_071849__202.json50.0missing{\n "num_gpu": 99\n}missing
12636Apple-MacBook-Pro-M1wrap_stringstarling-lm:latestJuliaRecapTask1SHOTtruetrue620231227_092240__44130.015.06112[375, 426]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/starling-lm:latest/evaluation__JuliaRecapTask__1SHOT__20231227_092240__441.json87.5missing{\n "num_gpu": 99\n}missing
12637Apple-MacBook-Pro-M1wrap_stringyi:34b-chatAsIs1SHOTfalsefalse620231214_090502__79200.012.46450[48, 376]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__AsIs__1SHOT__20231214_090502__792.json0.0missingmissingmissing
12638Apple-MacBook-Pro-M1wrap_stringyi:34b-chatAsIs1SHOTfalsefalse620231225_072508__38900.084.14830[62, 624]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_072508__389.json0.0missing{\n "num_gpu": 99\n}missing
12639Apple-MacBook-Pro-M1wrap_stringyi:34b-chatAsIs1SHOTfalsefalse620231225_072611__91300.062.91520[62, 469]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__AsIs__1SHOT__20231225_072611__913.json0.0missing{\n "num_gpu": 99\n}missing
12640Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231214_090449__83000.013.24380[65, 395]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231214_090449__830.json50.0missingmissingmissing
12641Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231225_072251__37200.060.59041[65, 447]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_072251__372.json62.5missing{\n "num_gpu": 99\n}missing
12642Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231225_072343__32800.051.44611[65, 379]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231225_072343__328.json62.5missing{\n "num_gpu": 99\n}missing
12643Apple-MacBook-Pro-M1wrap_stringyi:34b-chatInJulia1SHOTtruetrue620231227_092511__71100.059.4781[65, 449]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__InJulia__1SHOT__20231227_092511__711.json62.5missing{\n "num_gpu": 99\n}missing
12644Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTfalsefalse620231214_090436__21300.09.967740[94, 291]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231214_090436__213.json0.0missingmissingmissing
12645Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruetrue620231225_072121__11640.036.90752[104, 263]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_072121__116.json91.6667missing{\n "num_gpu": 99\n}missing
12646Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruetrue620231225_072151__26800.029.4341[104, 206]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231225_072151__268.json62.5missing{\n "num_gpu": 99\n}missing
12647Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertAsk1SHOTtruetrue620231227_092411__51210.029.07282[104, 208]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertAsk__1SHOT__20231227_092411__512.json79.1667missing{\n "num_gpu": 99\n}missing
12648Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue620231214_090426__40210.027.55170[175, 739]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231214_090426__402.json54.1667missingmissingmissing
12649Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue620231225_072015__30200.055.67931[184, 203]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_072015__302.json62.5missing{\n "num_gpu": 99\n}missing
12650Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruetrue620231225_072044__10550.028.31552[184, 186]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231225_072044__105.json95.8333missing{\n "num_gpu": 99\n}missing
12651Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaExpertCoTTask1SHOTtruefalse620231227_092342__60700.051.80430[184, 200]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaExpertCoTTask__1SHOT__20231227_092342__607.json25.0missing{\n "num_gpu": 99\n}missing
12652Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue620231214_090547__68100.020.29492[11, 549]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231214_090547__681.json75.0missingmissingmissing
12653Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue620231225_073013__76600.081.54251[378, 528]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073013__766.json62.5missing{\n "num_gpu": 99\n}missing
12654Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTfalsefalse620231225_073023__25500.09.983160[378, 15]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231225_073023__255.json0.0missing{\n "num_gpu": 99\n}missing
12655Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapCoTTask1SHOTtruetrue620231227_092640__97800.043.19220[378, 269]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapCoTTask__1SHOT__20231227_092640__978.json50.0missing{\n "num_gpu": 99\n}missing
12656Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruetrue620231214_090527__76600.025.22132[365, 596]0.10.0-DEV21.1{}PromptingTools.OllamaManagedSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231214_090527__766.json75.0missingmissingmissing
12657Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruetrue620231225_072708__87300.057.20560[376, 363]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_072708__873.json50.0missing{\n "num_gpu": 99\n}missing
12658Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruetrue620231225_072851__77800.0103.2321[376, 667]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231225_072851__778.json62.5missing{\n "num_gpu": 99\n}missing
12659Apple-MacBook-Pro-M1wrap_stringyi:34b-chatJuliaRecapTask1SHOTtruefalse620231227_092557__17100.045.42910[376, 286]0.10.0-DEV21.1{\n "options": {\n "num_gpu": 99\n }\n}PromptingTools.OllamaSchema()/home/runner/work/Julia-LLM-Leaderboard/Julia-LLM-Leaderboard/code_generation/utility_functions/wrap_string/yi:34b-chat/evaluation__JuliaRecapTask__1SHOT__20231227_092557__171.json25.0missing{\n "num_gpu": 99\n}missing

Overview of Prompt Templates

We've added an "AsIs" prompt template, which is just the raw task definition (nothing added). As you can see below, it's pretty bad, because the models fail to detect from the context that they should produce Julia code. In short, always use a prompt template, even if it's just a simple one.

Show scatter plot elapsed / score, where prompts are separated by different colors.

fig = @chain df begin
    @aside local xlims = quantile(df.elapsed_seconds, [0.01, 0.99])
    @rsubset !occursin("--optim", :model)
    @by [:model, :prompt_label] begin
        :elapsed = mean(:elapsed_seconds)
        :elapsed_median = median(:elapsed_seconds)
        :score = mean(:score)
        :score_median = median(:score)
        :cnt = $nrow
    end
    data(_) * mapping(:elapsed => "Avg. Elapsed Time (s)",
        :score => "Avg. Score (Max 100 pts)",
        color = :prompt_label => "Prompt")
    draw(; figure = (size = (600, 600),),
        axis = (xticklabelrotation = 45,
            title = "Elapsed Time vs Score by Prompt [PRELIMINARY]",
            limits = (xlims..., nothing, nothing)),
        palettes = (; color = Makie.ColorSchemes.tab20.colors))
end
SAVE_PLOTS && save("assets/elapsed-vs-score-scatter-prompts.png", fig)
fig

A few learnings so far:

  • Never use the "AsIs" prompt (ie, raw task definition). ALWAYS add some context around the language, situation, etc.
  • Even a simple "In Julia, answer XYZ" prompt can be quite effective. Note that the bigger prompts ("CoT" stands for Chain of Thought) might be confusing the smaller models, hence why this prompt is so effective on average.

Table:

output = @chain df begin
    @by [:prompt_label] begin
        :elapsed = mean(:elapsed_seconds)
        :elapsed_median = median(:elapsed_seconds)
        :score = mean(:score)
        :score_median = median(:score)
    end
    transform(_, names(_, Number) .=> ByRow(x -> round(x, digits = 1)), renamecols = false)
    @orderby -:score
    rename("prompt_label" => "Prompt Template",
        "score" => "Avg. Score (Max 100 pts)",
        "elapsed_median" => "Elapsed (s, median)",
        "elapsed" => "Elapsed (s, average)",
        "score_median" => "Median Score (Max 100 pts)")
end
# markdown_table(output, String) |> clipboard
markdown_table(output)
Prompt TemplateElapsed (s, average)Elapsed (s, median)Avg. Score (Max 100 pts)Median Score (Max 100 pts)
InJulia15.210.749.950.0
JuliaExpertAsk10.46.946.750.0
JuliaRecapTask18.714.045.950.0
JuliaExpertCoTTask17.112.742.050.0
JuliaRecapCoTTask17.813.241.250.0
AsIs36.311.29.80.0

This page was generated using Literate.jl.